Geekzone: technology news, blogs, forums
Guest
Welcome Guest.
You haven't logged in yet. If you don't have an account you can register now.




1134 posts

Uber Geek
+1 received by user: 741

Trusted
BigPipe

Topic # 145468 19-May-2014 09:38
Send private message

Surprised nobody has posted this here yet, but in the interest of transparency I think it is useful to note that chorus is having some major issues right now with provisioning and faults systems, which means no new connections can be processed and no faults can be logged or worked on.  This is affecting all ISPs who interact with Chorus - which is basically everybody.

Sucks for us as an ISP, and sucks for anybody in the midst of transitioning broadband providers as this will either be delayed, or, if not done properly, cannot be escalated and fixed.


Email from Chorus:

Good morning,   Chorus continue to experience an outage of various internal systems, including OFM, SPM, SSP, Chorus Portal and our inbound phone queues company-wide.   Currently we are unable to complete any provisioning or fault restoration work. Please phone through any medical emergencies via the following escalation channels;

We do not have an ETA for service restoration, however our technical teams are investigating and we endeavour to keep you updated


ETA: Confirmed that this is indeed infrastructure that Chorus and Telecom still share post demerger that has gone haywire, so it's definitely related.

Not trying to bag Chorus here, just trying to be transparent about what things aren't working and why.
Looks like the issue is (mostly) fixed now anyway (as at 5.50pm Monday 19.05).


(we're not impacted by the Telecom component of the outage as we are on totally separate systems, but we are impacted by this Chorus outage)




www.bigpipe.co.nz
https://www.facebook.com/BigPipeNZ
https://twitter.com/BigPipeNZ

Filter this topic showing only the reply marked as answer Create new topic

dan

914 posts

Ultimate Geek
+1 received by user: 74


  Reply # 1047831 19-May-2014 09:42
Send private message

hmm, got a line and broadband install happening in 20 mins, chrous tech didnt mention anything about it





1134 posts

Uber Geek
+1 received by user: 741

Trusted
BigPipe

  Reply # 1047833 19-May-2014 09:45
Send private message

dan: hmm, got a line and broadband install happening in 20 mins, chrous tech didnt mention anything about it




I'm guessing here,  but physical work already planned can likely still go ahead (i.e. techs in vans doing stuff)  but faults cannot be logged  if he stuffs it up,  and new orders cannot be placed.

Also note that the techs aren't directly employed by Chorus, they are employed by a sub-contractor (e.g. Visionstream) who have their own systems, so potentially may not be affected as much.




www.bigpipe.co.nz
https://www.facebook.com/BigPipeNZ
https://twitter.com/BigPipeNZ

 
 
 
 


25822 posts

Uber Geek
+1 received by user: 5552

Moderator
Trusted
Biddle Corp
Lifetime subscriber

  Reply # 1047834 19-May-2014 09:45
2 people support this post
Send private message

It's worth noting it's not actually a Chorus fault - it's a total meltdown of Telecom's internal network which has taken Telecom pretty much offline.

Many Chorus systems are still legacy and hosted by Telecom hence the problem.




2499 posts

Uber Geek
+1 received by user: 927

Subscriber

  Reply # 1047836 19-May-2014 09:46
Send private message

Sounds like someone's gonna be crying themselves to sleep over their stuffup :P




Windows 7 x64 // i5-3570K // 16GB DDR3-1600 // GTX660Ti 2GB // Samsung 830 120GB SSD // OCZ Agility4 120GB SSD // Samsung U28D590D @ 3840x2160 & Asus PB278Q @ 2560x1440
Samsung Galaxy S5 SM-G900I w/Spark

2537 posts

Uber Geek
+1 received by user: 326

Trusted

  Reply # 1047839 19-May-2014 09:49
Send private message

Would it be related to that upgrade in the weekend affecting mobile?

25822 posts

Uber Geek
+1 received by user: 5552

Moderator
Trusted
Biddle Corp
Lifetime subscriber

  Reply # 1047842 19-May-2014 09:51
Send private message

DjShadow: Would it be related to that upgrade in the weekend affecting mobile?


No idea. Telecom internally has pretty much ground to a halt with pretty much every system down from what I've heard.




BDFL - Memuneh
59406 posts

Uber Geek
+1 received by user: 10615

Administrator
Trusted
Geekzone
Lifetime subscriber

  Reply # 1047843 19-May-2014 09:52
Send private message

sbiddle: It's worth noting it's not actually a Chorus fault - it's a total meltdown of Telecom's internal network which has taken Telecom pretty much offline.

Many Chorus systems are still legacy and hosted by Telecom hence the problem.



Please follow the Telecom Meltdown here.




3325 posts

Uber Geek
+1 received by user: 985


  Reply # 1047844 19-May-2014 09:53
Send private message


Maybe you mean all subscribers connected via chorus?

I'm with UFF (via snap) and they seem just fine. 



25822 posts

Uber Geek
+1 received by user: 5552

Moderator
Trusted
Biddle Corp
Lifetime subscriber

  Reply # 1047847 19-May-2014 09:57
Send private message

surfisup1000:
Maybe you mean all subscribers connected via chorus?

I'm with UFF (via snap) and they seem just fine. 




The issue is nothing to do with Chorus provided ISP services. If you have internet through a Chorus wholesale connection you will not be affected unless you're with Telecom where you may be affected due to their DNS outage.

The issue is with Telecom's internal network affecting Chorus backend systems. Most of the Chorus systems are legacy products still run on Telecom infrastructure so are affected by this outage.


Talk DIrtY to me
4060 posts

Uber Geek
+1 received by user: 2109

Trusted
Subscriber

  Reply # 1047950 19-May-2014 12:29
13 people support this post
Send private message

Have Telecom installed a master splitter yet? That'll fix everything.




Whatifthespacekeyhadneverbeeninvented?




1134 posts

Uber Geek
+1 received by user: 741

Trusted
BigPipe

  Reply # 1048268 19-May-2014 17:49
Send private message

sbiddle:
surfisup1000:
Maybe you mean all subscribers connected via chorus?

I'm with UFF (via snap) and they seem just fine. 




The issue is nothing to do with Chorus provided ISP services. If you have internet through a Chorus wholesale connection you will not be affected unless you're with Telecom where you may be affected due to their DNS outage.

The issue is with Telecom's internal network affecting Chorus backend systems. Most of the Chorus systems are legacy products still run on Telecom infrastructure so are affected by this outage.



Yep, confirmed that this is the case. It's infrastructure that Chorus and Telecom still share post demerger that has gone haywire.


Not trying to bag Chorus here, just trying to be transparent about what things aren't working and why.


Looks like the issue is (mostly) fixed now.






www.bigpipe.co.nz
https://www.facebook.com/BigPipeNZ
https://twitter.com/BigPipeNZ

Filter this topic showing only the reply marked as answer Create new topic



Twitter »

Follow us to receive Twitter updates when new discussions are posted in our forums:



Follow us to receive Twitter updates when news items and blogs are posted in our frontpage:



Follow us to receive Twitter updates when tech item prices are listed in our price comparison site:





News »

New Zealand hits peak broadband data
Posted 18-Jan-2018 12:21


Amazon Echo devices coming to New Zealand early February 2018
Posted 18-Jan-2018 10:53


$3.74 million for new electric vehicles in New Zealand
Posted 17-Jan-2018 11:27


Nova 2i: Value, not excitement from Huawei
Posted 17-Jan-2018 09:02


Less news in Facebook News Feed revamp
Posted 15-Jan-2018 13:15


Australian Government contract awarded to Datacom Connect
Posted 11-Jan-2018 08:37


Why New Zealand needs a chief technology officer
Posted 6-Jan-2018 13:59


Amazon release Silk Browser and Firefox for Fire TV
Posted 21-Dec-2017 13:42


New Chief Technology Officer role created
Posted 19-Dec-2017 22:18


All I want for Christmas is a new EV
Posted 19-Dec-2017 19:54


How clever is this: AI will create 2.3 million jobs by 2020
Posted 19-Dec-2017 19:52


NOW to deploy SD-WAN to regional councils
Posted 19-Dec-2017 19:46


Mobile market competition issues ComCom should watch
Posted 18-Dec-2017 10:52


New Zealand government to create digital advisory group
Posted 16-Dec-2017 08:47


Australia datum changes means whole country moving 1.8 metres north-east
Posted 16-Dec-2017 08:39



Geekzone Live »

Try automatic live updates from Geekzone directly in your browser, without refreshing the page, with Geekzone Live now.



Are you subscribed to our RSS feed? You can download the latest headlines and summaries from our stories directly to your computer or smartphone by using a feed reader.

Alternatively, you can receive a daily email with Geekzone updates.