Geekzone: technology news, blogs, forums
Guest
Welcome Guest.
You haven't logged in yet. If you don't have an account you can register now.



1686 posts

Uber Geek
+1 received by user: 129


Topic # 111627 9-Nov-2012 14:29 Send private message

I guess Ms Curran's definition of catastrophic is slightly different from the general usage when a figure of eight cable has a single break and simply reroutes traffic via the rest of the ring.

Anyone lost any connectivity to OZ?

http://www.labour.org.nz/news/%E2%80%98catastrophic-failure%E2%80%99-hits-southern-cross-cable

A catastrophic failure has struck the Southern Cross international internet cable, says Labour’s Communications and IT spokesperson Clare Curran.

“Labour has learnt that a catastrophic failure at Southern Cross’s Alexandria landing station occurred this morning due to an unauthorised and un-notified software change to their wavelength switching platform at Alexandria, which blew up.

“We understand that partial service has been restored by reinstating old circuits via New Zealand. Full restoration is still being worked on.

“This shows the Government’s inaction and disregard for our international infrastructure could have equally catastrophic consequences for New Zealand.

“This is a crisis for New Zealand. Without international connectivity, our financial system and a large percentage of business would be severely affected.

“The Government must address the issue of international connectivity with urgency and provide a full assessment of the risks New Zealand faces through software failures and natural events on the single cable.

“Issues of capacity and affordability of data pale into insignificance when you consider the havoc that could be wrecked by a significant outage. This is a matter of grave importance for New Zealand.”

Filter this topic showing only the reply marked as answer View this topic in a long page with up to 500 replies per page Create new topic
 1 | 2 | 3
1082 posts

Uber Geek
+1 received by user: 47


  Reply # 714709 9-Nov-2012 14:31 Send private message

i only heard of vocus losing connectivity. but it does seem more pointful to me than ufb.

1465 posts

Uber Geek
+1 received by user: 111

Trusted

  Reply # 714714 9-Nov-2012 14:40 Send private message

But hang on a second wasn't Pacific Fibre only talking about doing a single circuit from AU-NZ-US?  No redundancy or second loop in that solution.  If they had managed to raise the $400Mil and built their cable then everyone between NZ & AU would be dead in the water.

Gotta be happy that SCCN DOES have redundant links, so even when a tech massively screws up they can still provide service.  Perhaps the 1.3Billion Investment SCCN made back in 1998 isn't that easy to replicate afterall.




Check out my Mobile Cell Site Google Maps KML Files in my blog.
Now using Google Fusion Tables or Address Lookup or GPS using Smartphone
I update it on a monthly basis automatically from RSM.

1082 posts

Uber Geek
+1 received by user: 47


  Reply # 714731 9-Nov-2012 15:06 Send private message

BarTender: But hang on a second wasn't Pacific Fibre only talking about doing a single circuit from AU-NZ-US?  No redundancy or second loop in that solution.  If they had managed to raise the $400Mil and built their cable then everyone between NZ & AU would be dead in the water.

Gotta be happy that SCCN DOES have redundant links, so even when a tech massively screws up they can still provide service.  Perhaps the 1.3Billion Investment SCCN made back in 1998 isn't that easy to replicate afterall.


providers can buy one patch on each cable though.


209 posts

Master Geek
+1 received by user: 17


  Reply # 714734 9-Nov-2012 15:10 Send private message

Is there a more official source than the Labour party website?
Also what kind of legitimate software update would cause hardware to "blow up"? this must be delibrate, or else unbelievably incompetent.

Voice Engineer @ Orcon
1927 posts

Uber Geek
+1 received by user: 435

Trusted
Orcon
Subscriber

  Reply # 714737 9-Nov-2012 15:13 Send private message

I should imagine the terminating equipment they use is very specialised, and to a large degree is probably custom.  So it's quite conceivable.  But it sounds as if proper change control was not followed in this case, which is the more alarming part.

However, there is redundancy, because it's a loop (effectively).  But losing a direct link to AU will obviously drive up latency to AU sites.

This does highlight the case for a 2nd International fiber provider.  What if some critical piece of equipment at SouthernCross failed, which took out both links?

1082 posts

Uber Geek
+1 received by user: 47


  Reply # 714738 9-Nov-2012 15:13 Send private message

Oncop53: Is there a more official source than the Labour party website?
Also what kind of legitimate software update would cause hardware to "blow up"? this must be delibrate, or else unbelievably incompetent.


http://www.nbr.co.nz/article/%E2%80%98catastrophic-failure-hits-southern-cross-cable-curran-ck-132090

6 posts

Wannabe Geek


  Reply # 714742 9-Nov-2012 15:19 Send private message

Umm... a what?

An "unauthorised and un-notified software change"?

Does this mean the 'cable operations software was hacked' or 'a tech changed something and got it wrong'?

Either is not good, but the first is worser.

I look forward to details.

Awesome
4001 posts

Uber Geek
+1 received by user: 577

Trusted
Subscriber

  Reply # 714747 9-Nov-2012 15:29 Send private message

What would have happened if the 'software patch' was applied to all of the wavelength switching platform gear across the whole SCCN?

Pac Fibre would at least add a second, independent supplier. If one or the other suppliers went totally offline, the other would (hopefully) still be up.




Twitter: ajobbins

Voice Engineer @ Orcon
1927 posts

Uber Geek
+1 received by user: 435

Trusted
Orcon
Subscriber

  Reply # 714770 9-Nov-2012 15:43 Send private message

ajobbins: What would have happened if the 'software patch' was applied to all of the wavelength switching platform gear across the whole SCCN?

Pac Fibre would at least add a second, independent supplier. If one or the other suppliers went totally offline, the other would (hopefully) still be up.


QFT.  And regardless of how much equipment redundancy there is within one supplier, these things can happen... Also, what if SCCF went bust, or got shut down for some other reason?  So much risk.

BDFL
49939 posts

Uber Geek
+1 received by user: 4624

Administrator
Trusted
Geekzone
Subscriber

  Reply # 714792 9-Nov-2012 16:17 Send private message

Oncop53: Is there a more official source than the Labour party website?


Just received from Southern Cross:


Contrary to a misleading and inaccurate media release from Labour’s Clare Curran, no ‘catastrophic failure’ has occurred on the Southern Cross Cable. 

The cable is, a figure of 8 network providing internet services to New Zealand, Australia, Pacific and the US.

In the early hours of this morning a limited outage affecting 10% of our active capacity occurred during our maintenance window which is a low traffic impacting period. 

The outage occurred at one of our Sydney cable stations, Alexandria, and it lasted from 3.17am – 4.28am, Sydney Time, impacting 4 of our customers. 

A problem occurred and the switch was reverted to its original software. 

The incident occurred as a part of authorised work taking place to expand capacity on the Southern Cross network.






1082 posts

Uber Geek
+1 received by user: 47


  Reply # 714795 9-Nov-2012 16:19 Send private message

freitasm:
Oncop53: Is there a more official source than the Labour party website?


Just received from Southern Cross:


Contrary to a misleading and inaccurate media release from Labour’s Clare Curran, no ‘catastrophic failure’ has occurred on the Southern Cross Cable. 

The cable is, a figure of 8 network providing internet services to New Zealand, Australia, Pacific and the US.

In the early hours of this morning a limited outage affecting 10% of our active capacity occurred during our maintenance window which is a low traffic impacting period. 

The outage occurred at one of our Sydney cable stations, Alexandria, and it lasted from 3.17am – 4.28am, Sydney Time, impacting 4 of our customers. 

A problem occurred and the switch was reverted to its original software. 

The incident occurred as a part of authorised work taking place to expand capacity on the Southern Cross network.




Then how come traceroute from telstra.net.au to vodafone was showing increased latency this morning (at reasonable hours).  Maybe Vocus had an outage of their own on top?

Voice Engineer @ Orcon
1927 posts

Uber Geek
+1 received by user: 435

Trusted
Orcon
Subscriber

  Reply # 714797 9-Nov-2012 16:21 Send private message

freitasm:
Oncop53: Is there a more official source than the Labour party website?


Just received from Southern Cross:


Contrary to a misleading and inaccurate media release from Labour’s Clare Curran, no ‘catastrophic failure’ has occurred on the Southern Cross Cable. 

The cable is, a figure of 8 network providing internet services to New Zealand, Australia, Pacific and the US.

In the early hours of this morning a limited outage affecting 10% of our active capacity occurred during our maintenance window which is a low traffic impacting period. 

The outage occurred at one of our Sydney cable stations, Alexandria, and it lasted from 3.17am – 4.28am, Sydney Time, impacting 4 of our customers. 

A problem occurred and the switch was reverted to its original software. 

The incident occurred as a part of authorised work taking place to expand capacity on the Southern Cross network.




That is a totally different story...

1082 posts

Uber Geek
+1 received by user: 47


  Reply # 714798 9-Nov-2012 16:23 Send private message

ubergeeknz:
freitasm:
Oncop53: Is there a more official source than the Labour party website?


Just received from Southern Cross:


Contrary to a misleading and inaccurate media release from Labour’s Clare Curran, no ‘catastrophic failure’ has occurred on the Southern Cross Cable. 

The cable is, a figure of 8 network providing internet services to New Zealand, Australia, Pacific and the US.

In the early hours of this morning a limited outage affecting 10% of our active capacity occurred during our maintenance window which is a low traffic impacting period. 

The outage occurred at one of our Sydney cable stations, Alexandria, and it lasted from 3.17am – 4.28am, Sydney Time, impacting 4 of our customers. 

A problem occurred and the switch was reverted to its original software. 

The incident occurred as a part of authorised work taking place to expand capacity on the Southern Cross network.




That is a totally different story...


http://lists.ausnog.net/pipermail/ausnog/2012-November/015297.html

gzt

4608 posts

Uber Geek
+1 received by user: 245

Subscriber

  Reply # 714802 9-Nov-2012 16:37 Send private message

mercutio: http://lists.ausnog.net/pipermail/ausnog/2012-November/015297.html


Well that was interesting but I cannot say I understand it.

Does it contradict or support the official statement in any way?

1082 posts

Uber Geek
+1 received by user: 47


  Reply # 714804 9-Nov-2012 16:39 Send private message

gzt:
mercutio: http://lists.ausnog.net/pipermail/ausnog/2012-November/015297.html


Well that was interesting but I cannot say I understand it.

Does it contradict the official statement in any way?


well it says it was unauthorised rather than routine.


 1 | 2 | 3
Filter this topic showing only the reply marked as answer View this topic in a long page with up to 500 replies per page Create new topic




Twitter »
Follow us to receive Twitter updates when new discussions are posted in our forums:



Follow us to receive Twitter updates when news items and blogs are posted in our frontpage:



Follow us to receive Twitter updates when tech item prices are listed in our price comparison site:





Trending now »

Hot discussions in our forums right now:

Snap refuses to replace faulty gear
Created by Brendan, last reply by Brendan on 26-Oct-2014 16:11 (25 replies)
Pages... 2


Speed limit when overtaking? Teach me please.
Created by nakedmolerat, last reply by Hobchild on 26-Oct-2014 00:11 (92 replies)
Pages... 5 6 7


House Auctions
Created by t0ny, last reply by mattwnz on 26-Oct-2014 17:20 (56 replies)
Pages... 2 3 4


VDSL, which router/modem sub $200?
Created by TeaLeaf, last reply by NonprayingMantis on 25-Oct-2014 19:48 (28 replies)
Pages... 2


Neon - Sky's new streaming service
Created by JarrodM, last reply by JimmyH on 25-Oct-2014 17:37 (29 replies)
Pages... 2


5Ghz AP recommendations?
Created by ubergeeknz, last reply by sbiddle on 24-Oct-2014 12:42 (12 replies)

Snap have failed our company!
Created by dafman, last reply by kornflake on 23-Oct-2014 17:41 (37 replies)
Pages... 2 3


Thief taunts 12 year old via stolen laptop
Created by macuser, last reply by charsleysa on 22-Oct-2014 23:49 (12 replies)


Geekzone Live »

Try automatic live updates from Geekzone directly in your browser, without refreshing the page, with Geekzone Live now.

Are you subscribed to our RSS feed? You can download the latest headlines and summaries from our stories directly to your computer or smartphone by using a feed reader.

Alternatively, you can receive a daily email with Geekzone updates.