Have Consumer Magazine lost it?

By Steve Biddle, in , posted: 24-Dec-2009 12:43

I've been a Consumer magazine reader on and off again for many years now. What I've noticed over the past few years however has been a complete change in direction of the organisation, a change for the worse. Articles have been poorly researched and written and it seems that as an organisation they're more focussed on getting their name out there in the media than they are on their core business of delivering unbiased, factual reviews of consumer goods and services.

This morning Consumer released a press release detailing the results of their yearly member survey of ISP's in New Zealand. This survey, taken by Consumer members ranks a list of the best and worst ISP's in New Zealand. This survey is available in the January/February version of Consumer and online on their website if you are a subscriber.

This survey does not rely on any technical testing, plan comparisions or ask the end user if they really know what they're talking about. It doesn't ask if they have master filter, have a shitty modem that will only sync at ADSL speeds on an ADSL2+ line or whether there internet is "slow" because they're downloading torrents on a plan that's clearly sold as being traffic managed 24 hours per day. The survey is also statistically flawed because it does not represent a true sample - it is a voluntary response that is also flawed because small ISP's with fewer responses can easily have skewed ratings. 

After browsing through this what really caught my attention was the section on mobile data

Mobile broadband

Nearly a quarter of survey respondents used their mobile phone for internet access.

New entrant 2degrees was the best for speed and connection reliability while Vodafone rated the worst on disconnections and dropouts, slower-than-expected speeds, and unexpected charges for excess usage.

I'm glad I wasn't eating Weetbix at the time because I would have choked on them. This claim by Consumer would have to be one of the most extravagant I've read anywhere for a long time.

Why? Because there is absolutely no way it can be true. I'd love to see Consumer magazine show some data that backs up this very bold claim that is presumably based solely on random end user comments rather than any actual performance testing.

2degrees have their own GSM mobile network in Auckland, Wellington, Christchurch and Queenstown. Their network also has EDGE deployed on top, this gives a maximum theoretical data speed of approximately 240kbps. If you're a 2degrees customer and are within these geographic boundaries you'll connect to the 2degrees network. Outside these areas your phone will connect to the Vodafone's GSM network and you will roam on this using GPRS that delivers a maximum speed of approximately 48kbps.

Both Vodafone and Telecom have nationwide WCDMA 3G networks. Both of these networks will deliver up to 7.2Mbps at present, both networks also have trial HSPA+ sites delivering real life speeds upwards of 16Mbps. Telecom's CDMA network is still in use by a large majority of their customers but is in effect is obsolete and typically no new connections are being made. Likewise Vodafone have more 3G customers on their network than GSM and the majority of handsets sold these days support 3G so for this comparision I'm solely comparing the two WCDMA networks.

I've spent the past couple of weeks doing some pretty extensive testing of both Vodafone and Telecom's XT network around the lower North Island and can conclusively say that without a doubt that there is no way the EDGE network deployed by 2degrees can come anywhere close to the speeds delivered on the Vodafone or Telecom XT networks. I did encounter some retainability issues on the XT network which now appear to be resolved but overall both networks perform extremely well. Across the XT network it's not uncommon to obtain speeds upwards of 6Mbps and with average speeds in the 2Mbps - 4Mbps region. On Vodafone speeds in the 1.5Mbps - 3Mbps range are fairly typical and with one exception near a crowded mall I've never received average speeds of under 1Mbps on either Vodafone or Telecom's XT network.

I've also succesfully tested a 1.3Mbps video stream to a laptop while mobile on the XT network and saw exceptionally low packet loss, even during handovers. Retainability and connectability (the ability to establish and hold a data connection) are very good on both networks. If that's not delivering a significantly better speed and connection reliability experience than the EDGE network deployed by 2dgrees then I don't know what is. 2degrees don't have a "bad" network, it's actually very good and in my testing there are no issues and speeds close to 200kbps are easily achievable. It's just simply no match for Vodafone or Telecom's XT network because it's older GSM technology that is simply inferior to the WCDMA technology that Vodafone and Telecom XT use. 2degrees will be launching WCDMA 3G services aross their network in early 2010.

In terms of charging a casual user on Vodafone or Telecom's XT network will pay more than a 2degrees customer for data "overuse" charges - but the statement itself is contentious. 2degrees do not offer any data plans, all data is priced at 50c per MB. On Vodafone or Telecom a casual user will pay $1 per day for up to 10MB of data usage, after that data is charged at $1 per MB but very few customers actually pay this. If you're a regular data user you'll have a data plan (which 2degrees don't offer) offering you data for 10c per MB or less.

So the challenge is out there for you Consumer - exactly what basis do you base these bold claims on and do you have any statistics to back them up?

Other related posts:
No, AT aren’t stealing your money. How Stuff confused a nation.
The perils of using Airbnb during big events
How to remotely control your heat pump from your phone for under NZ$25

comments powered by Disqus

sbiddle's profile

Steve Biddle
New Zealand

I'm an engineer who loves building solutions to solve problems.

I also love sharing my views and analysis of the tech world on this blog, along with the odd story about aviation and the travel industry.

My interests and skillset include:

*VoIP (Voice over IP). I work with various brands of hardware and PBX's on a daily basis
  -Asterisk (incl PiaF, FreePBX, Elastix)

  -xDSL deployments

*Structured cabling
  -Home/office cabling
  -Phone & Data

*Computer networking
  -Mikrotik hardware
  -WAN/LAN solutions

*Wireless solutions
  -Motel/Hotel hotspot deployments
  -Outdoor wireless deployments, both small and large scale
  -Temporary wireless deployments
*CCTV solutions
  -Analogue and IP

I'm an #avgeek who loves to travel the world (preferably in seat 1A) and stay in nice hotels.

+My views do no represent my employer. I'm sure they'll be happy to give their own if you ask them.

You can contact me here or by email at stevenbiddle@gmail.com