Geekzone: technology news, blogs, forums
Guest
Welcome Guest.
You haven't logged in yet. If you don't have an account you can register now.




245 posts

Master Geek
+1 received by user: 11


Topic # 42825 12-Oct-2009 11:03
Send private message

Would love to be sitting in on that one!


[Mod (N8): Moved forums]

View this topic in a long page with up to 500 replies per page Create new topic
 1 | 2
2513 posts

Uber Geek
+1 received by user: 284

Trusted
Subscriber

  Reply # 263467 12-Oct-2009 12:27
Send private message

Yep. I would love to be there too. It was pretty chaotic yesterday. Very unfortunate day to happen on being the last day of the holidays.




My views (except when I am looking out their windows) are not those of my employer.

7442 posts

Uber Geek
+1 received by user: 670

Subscriber

  Reply # 263476 12-Oct-2009 12:55
Send private message

I guess AIR NZ problems weren't made any better due to the fact that they have gotten rid of most manual checkin desks. Automated checkin only these days..




Regards,

Old3eyes


 
 
 
 


1969 posts

Uber Geek
+1 received by user: 180

Trusted
Subscriber

  Reply # 263477 12-Oct-2009 12:56
Send private message

If the tone of this email is carried into the meeting it would be an absolute ripper!

http://www.stuff.co.nz/business/industries/2955289/Air-New-Zealand-boss-criticises-IBM-over-outage

(sorry, javascript disabled on work computer so can't put it in as a proper link)

33 posts

Geek


  Reply # 263479 12-Oct-2009 13:01
Send private message

doubt we'll get to know the true stary

52 posts

Master Geek


  Reply # 263482 12-Oct-2009 13:18
Send private message

We aren't all running around in a blind panic...yet

125 posts

Master Geek


Reply # 263484 12-Oct-2009 13:24
Send private message

Well I can say that AIr NZ were not the only company impacted as the IBM data center holds many differnet companyies systems.  Ours were impacted but thank god they had redundancy and the majority were not customer facing.

The email tells you what happened.  There is a little more to it but essentialy in laymans terms what was said is correct.

I know I was very busy yesterday arvo trying to sort out engineers and parts replacements due to blown power supplies etc. Yell

261 posts

Ultimate Geek


  Reply # 263485 12-Oct-2009 13:24
Send private message

I imagine it will go like this:
AirNZ: Why haven't you provided DR?
IBM: You haven't paid for it.
AirNZ: Ah, right.

125 posts

Master Geek


  Reply # 263489 12-Oct-2009 13:50
Send private message

LOL you are probably right there

I'm @nate
6271 posts

Uber Geek
+1 received by user: 366

Moderator
Trusted
Subscriber

  Reply # 263512 12-Oct-2009 15:54
Send private message

corksta: If the tone of this email is carried into the meeting it would be an absolute ripper!

http://www.stuff.co.nz/business/industries/2955289/Air-New-Zealand-boss-criticises-IBM-over-outage


There are some absolute gems in that news article about IBM including:

I am struggling to recall a time where I have seen a supplier so slow to react to a catastrophic system failure such as this and so unwilling to accept responsibility and apologise to its client and its client's customers


and

I have been left with no option but to ask the IT team to review the full range of options available to us


Oops and ouch.




I iz your trusted friend
5755 posts

Uber Geek
+1 received by user: 134

Mod Emeritus
Trusted
Subscriber

  Reply # 263520 12-Oct-2009 16:19
Send private message

We had IBM SANs and that when horribly wrong on two Fridays ago... and the crew still trying to fix it... what happened was the SANs' dual controllers gone dead at the same time, chances of that happening is really really really really rare!




Internet is my backyard...

 

«Geekzone blog: Tech 'n Chips Takeaway» «Personal blog: And then...»

 

Please read the Geekzone's FUG

 


1969 posts

Uber Geek
+1 received by user: 180

Trusted
Subscriber

  Reply # 263524 12-Oct-2009 16:46
Send private message

nate:
corksta: If the tone of this email is carried into the meeting it would be an absolute ripper!

http://www.stuff.co.nz/business/industries/2955289/Air-New-Zealand-boss-criticises-IBM-over-outage


There are some absolute gems in that news article about IBM including:

I am struggling to recall a time where I have seen a supplier so slow to react to a catastrophic system failure such as this and so unwilling to accept responsibility and apologise to its client and its client's customers


and

I have been left with no option but to ask the IT team to review the full range of options available to us


Oops and ouch.



Agreed! My fiance is a flight attendant for Air NZ and got home at 3.30am this morning (delayed 4 hours) so she was having a chuckle too. His internal emails are normally quite placid so this must have really riled him up!

2482 posts

Uber Geek
+1 received by user: 433


  Reply # 263526 12-Oct-2009 17:06
Send private message

You sorta wonder if the intitial call from Air NZ to IBM was picked up by some low level desk warmer, who on a Sunday afternoon replied with something like, "its the weekend call back monday" :D



BDFL - Memuneh
58091 posts

Uber Geek
+1 received by user: 9633

Administrator
Trusted
Geekzone
Subscriber

Reply # 263527 12-Oct-2009 17:12
Send private message

wellygary: You sorta wonder if the intitial call from Air NZ to IBM was picked up by some low level desk warmer, who on a Sunday afternoon replied with something like, "its the weekend call back monday" :D



Or "Have you tried turning the computer off and on again?"





1287 posts

Uber Geek
+1 received by user: 319


  Reply # 263720 13-Oct-2009 19:01
Send private message

I'm quite surprised it all went so pear shaped, when I was on the AirNZ account at IBM it was all reasonably well setup and they'd had power outages before that they'd survived .... guess a lot changes in 5 years though.

You can bet the "no apologies from IBM" part is because the IBM lawyers would forbid anyone apologising because it admits blame, there will be the root cause analysis and follow on investigations to do before any says anything.

Mark




DRZ  Smarterer


2240 posts

Uber Geek
+1 received by user: 352

Trusted
Subscriber

  Reply # 263927 14-Oct-2009 18:17
Send private message

nate:
corksta: If the tone of this email is carried into the meeting it would be an absolute ripper!

http://www.stuff.co.nz/business/industries/2955289/Air-New-Zealand-boss-criticises-IBM-over-outage


There are some absolute gems in that news article about IBM including:

I am struggling to recall a time where I have seen a supplier so slow to react to a catastrophic system failure such as this and so unwilling to accept responsibility and apologise to its client and its client's customers


Oops and ouch.


Well interestingly enough I was having a discussion on sunday morning about VMware and virtualisation etc with one of the IBM on call engineers when he got a very frantic phone call advising him of multiple systems down. He junmped up got his PC/Mac from this car and plugged in the Vodafone wireless connection and started looking at all the virtual machines which were down, after which he made anther call and had to go to the data centre.

Hardly slow response from the Engineer. I suspect it took a while for IBM to contact their techs to sort the problem out from what it sounds.

Interestingly enough that data centre is being decommissioned from what I hear and all services pulled over to the new Orbit Data Centre in Albany which is Tier 3+ versus only Tier 2.

Without knowing what SLA was sold to Air New Zealand and what they paid for in terms of DR, no ammount of finger pointing will fix.

 1 | 2
View this topic in a long page with up to 500 replies per page Create new topic



Twitter »

Follow us to receive Twitter updates when new discussions are posted in our forums:



Follow us to receive Twitter updates when news items and blogs are posted in our frontpage:



Follow us to receive Twitter updates when tech item prices are listed in our price comparison site:





News »

Red Hat unveils production-ready open source hyperconverged infrastructure
Posted 23-Jun-2017 22:10


Whatever ailed Vodafone broadband … seems to be fixed
Posted 23-Jun-2017 14:10


VMware NSX Meets Stringent Government Security Standards with Common Criteria Certification
Posted 22-Jun-2017 19:05


Brother launches next-generation colour laser printers and all-in- ones for business
Posted 22-Jun-2017 18:56


Intel and IOC announce partnership
Posted 22-Jun-2017 18:50


Samsung Galaxy Tab S3: Best Android tablet
Posted 21-Jun-2017 12:05


Wellington-based company helping secure Microsoft browsers
Posted 20-Jun-2017 20:51


Endace delivers high performance with new 1/10/40 Gbps packet capture card
Posted 20-Jun-2017 20:50


You can now integrate SMX security into Microsoft Office 365, Google and other cloud email platforms
Posted 20-Jun-2017 20:47


Ravensdown launches new decision-making tool HawkEye
Posted 19-Jun-2017 15:38


Spark planning to take on direct management of all consumer stores
Posted 19-Jun-2017 10:03


Qrious acquires Ubiquity
Posted 14-Jun-2017 12:21


Spark New Zealand prepares for 5G with Nokia
Posted 14-Jun-2017 12:16


The future-proof 10.5-inch iPad Pro
Posted 13-Jun-2017 18:16


Mandatory data breach reporting in Australia
Posted 13-Jun-2017 11:30



Geekzone Live »

Try automatic live updates from Geekzone directly in your browser, without refreshing the page, with Geekzone Live now.



Are you subscribed to our RSS feed? You can download the latest headlines and summaries from our stories directly to your computer or smartphone by using a feed reader.

Alternatively, you can receive a daily email with Geekzone updates.