Geekzone: technology news, blogs, forums
Guest
Welcome Guest.
You haven't logged in yet. If you don't have an account you can register now.



1247 posts

Uber Geek


Topic # 111627 9-Nov-2012 14:29 Send private message

I guess Ms Curran's definition of catastrophic is slightly different from the general usage when a figure of eight cable has a single break and simply reroutes traffic via the rest of the ring.

Anyone lost any connectivity to OZ?

http://www.labour.org.nz/news/%E2%80%98catastrophic-failure%E2%80%99-hits-southern-cross-cable

A catastrophic failure has struck the Southern Cross international internet cable, says Labour’s Communications and IT spokesperson Clare Curran.

“Labour has learnt that a catastrophic failure at Southern Cross’s Alexandria landing station occurred this morning due to an unauthorised and un-notified software change to their wavelength switching platform at Alexandria, which blew up.

“We understand that partial service has been restored by reinstating old circuits via New Zealand. Full restoration is still being worked on.

“This shows the Government’s inaction and disregard for our international infrastructure could have equally catastrophic consequences for New Zealand.

“This is a crisis for New Zealand. Without international connectivity, our financial system and a large percentage of business would be severely affected.

“The Government must address the issue of international connectivity with urgency and provide a full assessment of the risks New Zealand faces through software failures and natural events on the single cable.

“Issues of capacity and affordability of data pale into insignificance when you consider the havoc that could be wrecked by a significant outage. This is a matter of grave importance for New Zealand.”

Filter this topic showing only the reply marked as answer View this topic in a long page with up to 500 replies per page Create new topic
 1 | 2 | 3Next
781 posts

Ultimate Geek


  Reply # 714709 9-Nov-2012 14:31 Send private message

i only heard of vocus losing connectivity. but it does seem more pointful to me than ufb.

1309 posts

Uber Geek

Trusted

  Reply # 714714 9-Nov-2012 14:40 Send private message

But hang on a second wasn't Pacific Fibre only talking about doing a single circuit from AU-NZ-US?  No redundancy or second loop in that solution.  If they had managed to raise the $400Mil and built their cable then everyone between NZ & AU would be dead in the water.

Gotta be happy that SCCN DOES have redundant links, so even when a tech massively screws up they can still provide service.  Perhaps the 1.3Billion Investment SCCN made back in 1998 isn't that easy to replicate afterall.




Check out my Mobile Cell Site Google Maps KML Files in my blog.
Now using Google Fusion Tables or Address Lookup or GPS using Smartphone
I update it on a monthly basis automatically from RSM.

781 posts

Ultimate Geek


  Reply # 714731 9-Nov-2012 15:06 Send private message

BarTender: But hang on a second wasn't Pacific Fibre only talking about doing a single circuit from AU-NZ-US?  No redundancy or second loop in that solution.  If they had managed to raise the $400Mil and built their cable then everyone between NZ & AU would be dead in the water.

Gotta be happy that SCCN DOES have redundant links, so even when a tech massively screws up they can still provide service.  Perhaps the 1.3Billion Investment SCCN made back in 1998 isn't that easy to replicate afterall.


providers can buy one patch on each cable though.


157 posts

Master Geek


  Reply # 714734 9-Nov-2012 15:10 Send private message

Is there a more official source than the Labour party website?
Also what kind of legitimate software update would cause hardware to "blow up"? this must be delibrate, or else unbelievably incompetent.

780 posts

Ultimate Geek

Trusted
Orcon
Subscriber

  Reply # 714737 9-Nov-2012 15:13 Send private message

I should imagine the terminating equipment they use is very specialised, and to a large degree is probably custom.  So it's quite conceivable.  But it sounds as if proper change control was not followed in this case, which is the more alarming part.

However, there is redundancy, because it's a loop (effectively).  But losing a direct link to AU will obviously drive up latency to AU sites.

This does highlight the case for a 2nd International fiber provider.  What if some critical piece of equipment at SouthernCross failed, which took out both links?

781 posts

Ultimate Geek


  Reply # 714738 9-Nov-2012 15:13 Send private message

Oncop53: Is there a more official source than the Labour party website?
Also what kind of legitimate software update would cause hardware to "blow up"? this must be delibrate, or else unbelievably incompetent.


http://www.nbr.co.nz/article/%E2%80%98catastrophic-failure-hits-southern-cross-cable-curran-ck-132090

4 posts

Wannabe Geek


  Reply # 714742 9-Nov-2012 15:19 Send private message

Umm... a what?

An "unauthorised and un-notified software change"?

Does this mean the 'cable operations software was hacked' or 'a tech changed something and got it wrong'?

Either is not good, but the first is worser.

I look forward to details.

Awesome
3004 posts

Uber Geek

Trusted
Subscriber

  Reply # 714747 9-Nov-2012 15:29 Send private message

What would have happened if the 'software patch' was applied to all of the wavelength switching platform gear across the whole SCCN?

Pac Fibre would at least add a second, independent supplier. If one or the other suppliers went totally offline, the other would (hopefully) still be up.




Twitter: ajobbins

780 posts

Ultimate Geek

Trusted
Orcon
Subscriber

  Reply # 714770 9-Nov-2012 15:43 Send private message

ajobbins: What would have happened if the 'software patch' was applied to all of the wavelength switching platform gear across the whole SCCN?

Pac Fibre would at least add a second, independent supplier. If one or the other suppliers went totally offline, the other would (hopefully) still be up.


QFT.  And regardless of how much equipment redundancy there is within one supplier, these things can happen... Also, what if SCCF went bust, or got shut down for some other reason?  So much risk.

BDFL
43727 posts

Uber Geek

Administrator
Trusted
Geekzone
Subscriber

  Reply # 714792 9-Nov-2012 16:17 Send private message

Oncop53: Is there a more official source than the Labour party website?


Just received from Southern Cross:


Contrary to a misleading and inaccurate media release from Labour’s Clare Curran, no ‘catastrophic failure’ has occurred on the Southern Cross Cable. 

The cable is, a figure of 8 network providing internet services to New Zealand, Australia, Pacific and the US.

In the early hours of this morning a limited outage affecting 10% of our active capacity occurred during our maintenance window which is a low traffic impacting period. 

The outage occurred at one of our Sydney cable stations, Alexandria, and it lasted from 3.17am – 4.28am, Sydney Time, impacting 4 of our customers. 

A problem occurred and the switch was reverted to its original software. 

The incident occurred as a part of authorised work taking place to expand capacity on the Southern Cross network.






781 posts

Ultimate Geek


  Reply # 714795 9-Nov-2012 16:19 Send private message

freitasm:
Oncop53: Is there a more official source than the Labour party website?


Just received from Southern Cross:


Contrary to a misleading and inaccurate media release from Labour’s Clare Curran, no ‘catastrophic failure’ has occurred on the Southern Cross Cable. 

The cable is, a figure of 8 network providing internet services to New Zealand, Australia, Pacific and the US.

In the early hours of this morning a limited outage affecting 10% of our active capacity occurred during our maintenance window which is a low traffic impacting period. 

The outage occurred at one of our Sydney cable stations, Alexandria, and it lasted from 3.17am – 4.28am, Sydney Time, impacting 4 of our customers. 

A problem occurred and the switch was reverted to its original software. 

The incident occurred as a part of authorised work taking place to expand capacity on the Southern Cross network.




Then how come traceroute from telstra.net.au to vodafone was showing increased latency this morning (at reasonable hours).  Maybe Vocus had an outage of their own on top?

780 posts

Ultimate Geek

Trusted
Orcon
Subscriber

  Reply # 714797 9-Nov-2012 16:21 Send private message

freitasm:
Oncop53: Is there a more official source than the Labour party website?


Just received from Southern Cross:


Contrary to a misleading and inaccurate media release from Labour’s Clare Curran, no ‘catastrophic failure’ has occurred on the Southern Cross Cable. 

The cable is, a figure of 8 network providing internet services to New Zealand, Australia, Pacific and the US.

In the early hours of this morning a limited outage affecting 10% of our active capacity occurred during our maintenance window which is a low traffic impacting period. 

The outage occurred at one of our Sydney cable stations, Alexandria, and it lasted from 3.17am – 4.28am, Sydney Time, impacting 4 of our customers. 

A problem occurred and the switch was reverted to its original software. 

The incident occurred as a part of authorised work taking place to expand capacity on the Southern Cross network.




That is a totally different story...

781 posts

Ultimate Geek


  Reply # 714798 9-Nov-2012 16:23 Send private message

ubergeeknz:
freitasm:
Oncop53: Is there a more official source than the Labour party website?


Just received from Southern Cross:


Contrary to a misleading and inaccurate media release from Labour’s Clare Curran, no ‘catastrophic failure’ has occurred on the Southern Cross Cable. 

The cable is, a figure of 8 network providing internet services to New Zealand, Australia, Pacific and the US.

In the early hours of this morning a limited outage affecting 10% of our active capacity occurred during our maintenance window which is a low traffic impacting period. 

The outage occurred at one of our Sydney cable stations, Alexandria, and it lasted from 3.17am – 4.28am, Sydney Time, impacting 4 of our customers. 

A problem occurred and the switch was reverted to its original software. 

The incident occurred as a part of authorised work taking place to expand capacity on the Southern Cross network.




That is a totally different story...


http://lists.ausnog.net/pipermail/ausnog/2012-November/015297.html

gzt

3202 posts

Uber Geek

Subscriber

  Reply # 714802 9-Nov-2012 16:37 Send private message

mercutio: http://lists.ausnog.net/pipermail/ausnog/2012-November/015297.html


Well that was interesting but I cannot say I understand it.

Does it contradict or support the official statement in any way?

781 posts

Ultimate Geek


  Reply # 714804 9-Nov-2012 16:39 Send private message

gzt:
mercutio: http://lists.ausnog.net/pipermail/ausnog/2012-November/015297.html


Well that was interesting but I cannot say I understand it.

Does it contradict the official statement in any way?


well it says it was unauthorised rather than routine.


 1 | 2 | 3Next
Filter this topic showing only the reply marked as answer View this topic in a long page with up to 500 replies per page Create new topic



Twitter »
Follow us to receive Twitter updates when new discussions are posted in our forums:



Follow us to receive Twitter updates when news items and blogs are posted in our frontpage:



Follow us to receive Twitter updates when new jobs are posted to our jobs board:



Follow us to receive Twitter updates when tech item prices are listed in our price comparison site:




News »

Trending now »
Hot discussions in our forums right now:

Xbox One
Created by DjShadow, last reply by merve0o0 on 22-May-2013 18:27 (37 replies)
Pages... 2 3


Cannabis is illegal yet we have really strong 'legal highs' ?
Created by qwerty7, last reply by P1n3apqlExpr3ss on 22-May-2013 21:44 (59 replies)
Pages... 2 3 4


A new project coming to Geekzone
Created by freitasm, last reply by networkn on 22-May-2013 23:26 (246 replies)
Pages... 15 16 17


Changeover issue: dial up
Created by Zigg, last reply by robjg63 on 21-May-2013 22:02 (17 replies)
Pages... 2


HTC One (2013) owners' discussion
Created by Dingbatt, last reply by psychrn on 22-May-2013 23:46 (1532 replies)
Pages... 101 102 103


"igov" online passport renewals
Created by Linuxluver, last reply by profrink on 22-May-2013 22:22 (29 replies)
Pages... 2


Orcon, Is this for real or a scam??
Created by old3eyes, last reply by DarthKermit on 22-May-2013 19:12 (29 replies)
Pages... 2


Vodafone Naked Broadband Speeds (Auckland CBD)
Created by wscalioni, last reply by grkiwi on 20-May-2013 21:13 (14 replies)


Geekzone Jobs »
Most recent NZ jobs in technology:

Intermediate Project Manager
Posted 22-May-2013 22:27

Project Manager - Data Centre
Posted 22-May-2013 22:27

Senior Embedded Software Engineer
Posted 22-May-2013 22:27

Senior Business Analyst
Posted 22-May-2013 22:27

Systems Support Administrator
Posted 22-May-2013 19:27

Senior Technical Business Analyst
Posted 22-May-2013 19:27

Network Reporting Engineer
Posted 22-May-2013 19:27


Geekzone Live »
Try automatic live updates from Geekzone directly in your browser, without refreshing the page, with Geekzone Live now.

Are you subscribed to our RSS feed? You can download the latest headlines and summaries from our stories directly to your computer or smartphone by using a feed reader.

Alternatively, you can receive a daily email with Geekzone updates.