Geekzone: technology news, blogs, forums
Guest
Welcome Guest.
You haven't logged in yet. If you don't have an account you can register now.


freitasm

BDFL - Memuneh
80729 posts

Uber Geek
+1 received by user: 41179

Administrator
ID Verified
Trusted
Geekzone
Lifetime subscriber

#73698 20-Dec-2010 09:25
Send private message

Just received:



The quality of New Zealand’s broadband services are continuing to improve according to a report released by the Commerce Commission today. The report, covering from 1 January – 30 June 2010, aims to provide a comparison of the relative performance of internet service providers (ISPs) in delivering broadband services in the major New Zealand cities.

“The report shows a continuing reduction in variability of web browsing speeds over the course of the day. Internet availability is also improving, with downtime reduced,” said Dr Ross Patterson, Telecommunications Commissioner. “The report also shows the benefits of local loop unbundling which continues to provide greater choice and better services for consumers.”

The key developments in the delivery quality of broadband services include: 
- The variability of web browsing speeds over the course of the day reduced considerably, particularly for ISPs who performed poorly in the last report.

- Internet availability continued to improve and only one ISP failed to meet the Commission’s monthly availability benchmark of 99.9 per cent .

- Vodafone had a noticeable improvement in web browsing performance in Auckland.

- TelstraClear’s cable broadband service continued to show materially faster national browsing speeds than DSL broadband plans in test locations where it was available.

- Web browsing speeds for ISPs who have unbundled Telecom exchanges improved to being around 20 per cent faster than access provided using Telecom Wholesale services for the last two months of the measurement period. The Commission will continue to monitor unbundled service speeds to determine whether the speed trend is consistent over future measurement periods.

The full report is available on the Commission’s website at www.comcom.govt.nz/broadband-reports

Background
Amendments to the Telecommunications Act 2001 have explicitly empowered the Commerce Commission to monitor the performance of telecommunications markets and report on this work. Accordingly, the Commission has been producing regular monitoring reports, including reporting on the quality of broadband services. 

This broadband quality report is part of a continuing series measuring broadband performance. The Commerce Commission has undertaken the analysis of the underlying data provided by Epitiro Technologies Limited.

Epitiro Technologies Limited is a company with experience in internet performance benchmarking. The Commerce Commission contracts Epitiro to provide the data for these broadband quality reports. As part of Epitiro’s work in the area, Epitiro also provides services to ISPs enabling them to benchmark customer performance across dial up, cable, broadband and wireless connections. 

The ISP-I platform and technology from Epitiro emulates an internet user’s activity across eleven sites. The sites are located in Auckland, Hamilton, Wellington, Christchurch and Dunedin. It measures twelve ISPs every fifteen minutes on a 24-hour basis across the eleven sites. The platform gathers a range of detailed statistics on seven parameters – synchronisation speed, cached and non-cached HTTP download speeds, ping, DNS, packet loss and email delivery times for independent analyses.
 




Referral links: Quic Broadband (free setup code: R587125ERQ6VE) | Samsung | AliExpress | Wise | Sharesies 

 

Support Geekzone by subscribing (browse ads-free), or making a one-off or recurring donation through PressPatron.

 


View this topic in a long page with up to 500 replies per page Create new topic
 1 | 2
Behodar
11129 posts

Uber Geek
+1 received by user: 6134

Trusted
Lifetime subscriber

  #419321 20-Dec-2010 09:52
Send private message

Ahahaha...

"The reference website used to test caching has been changed for this reporting period. The change was necessary to remove the impact of 'special' caching undertaken by some ISPs for the otherwise rarely used website previously used as a reference. To avoid similar issues in the future, the new reference website will not be named."

I wonder who that was :P



freitasm

BDFL - Memuneh
80729 posts

Uber Geek
+1 received by user: 41179

Administrator
ID Verified
Trusted
Geekzone
Lifetime subscriber

  #419325 20-Dec-2010 09:55
Send private message

ISP cheating is nothing new, if we go by the reports here on Geekzone of ISPs giving priority to packets travelling the Tubes to the speedtest.net servers...





Referral links: Quic Broadband (free setup code: R587125ERQ6VE) | Samsung | AliExpress | Wise | Sharesies 

 

Support Geekzone by subscribing (browse ads-free), or making a one-off or recurring donation through PressPatron.

 


Talkiet
4819 posts

Uber Geek
+1 received by user: 3935

Trusted

  #419327 20-Dec-2010 09:57
Send private message

Behodar: Ahahaha...

"The reference website used to test caching has been changed for this reporting period. The change was necessary to remove the impact of 'special' caching undertaken by some ISPs for the otherwise rarely used website previously used as a reference. To avoid similar issues in the future, the new reference website will not be named."

I wonder who that was :P


Well, I know who it was, and the fact Epitiro are trying to keep the site used secret is a joke... If the cheating ISP wanted, they could trivially find out what site is being used by monitoring the traffic on the test line and start caching the new site.

I glanced over the whole report and in general the quality of the report seems consistent with earlier efforts.

Cheers - N




Please note all comments are from my own brain and don't necessarily represent the position or opinions of my employer, previous employers, colleagues, friends or pets.




Behodar
11129 posts

Uber Geek
+1 received by user: 6134

Trusted
Lifetime subscriber

  #419329 20-Dec-2010 10:02
Send private message

Talkiet: Well, I know who it was, and the fact Epitiro are trying to keep the site used secret is a joke... If the cheating ISP wanted, they could trivially find out what site is being used by monitoring the traffic on the test line and start caching the new site.

I suspected that that was possible too. Time will tell!

DonGould
3892 posts

Uber Geek
+1 received by user: 164


  #419341 20-Dec-2010 10:54
Send private message

The solution is for more of us to support more projects like truenet and others then let all the isp just improve the speeds to everything ;)





Promote New Zealand - Get yourself a .kiwi.nz domain name!!!

Check out mine - i.am.a.can.do.kiwi.nz - don@i.am.a.can.do.kiwi.nz


ptinson
677 posts

Ultimate Geek
+1 received by user: 27

Trusted

  #419344 20-Dec-2010 11:08
Send private message

Behodar: Ahahaha...

"The reference website used to test caching has been changed for this reporting period. The change was necessary to remove the impact of 'special' caching undertaken by some ISPs for the otherwise rarely used website previously used as a reference. To avoid similar issues in the future, the new reference website will not be named."

I wonder who that was :P


I can say that we place no priority caching, or particular caching strategy on sites based on Epitiro or any other test probe destinations.

As Talkiet points out though, finding out what sites any test probe is hitting is trivial so not publishing the list is any interesting tack to take.

Paul




meat popsicle

 
 
 
 

Shop now for Dell laptops and other devices (affiliate link).
DonGould
3892 posts

Uber Geek
+1 received by user: 164


  #419346 20-Dec-2010 11:11
Send private message

I've been following a pjt in .au on this stuff. What I don't get is why the test sites aren't pulling daily updates from a server and using different ranges of sites. Wouldn't that get a much clearer indication of the true performance anyway?

D




Promote New Zealand - Get yourself a .kiwi.nz domain name!!!

Check out mine - i.am.a.can.do.kiwi.nz - don@i.am.a.can.do.kiwi.nz


Ragnor
8279 posts

Uber Geek
+1 received by user: 585

Trusted

  #419358 20-Dec-2010 11:34
Send private message

DonGould: The solution is for more of us to support more projects like truenet and others then let all the isp just improve the speeds to everything ;)



It would be quite simple for an ISP's network admin to prioritise the sites/addresses truenet are using for testing.

DonGould
3892 posts

Uber Geek
+1 received by user: 164


  #419365 20-Dec-2010 11:48
Send private message

Yip, which is why we need a range of projects with the ability to update the sites daily.

How much time are the network admins going to put into chasing all the different sites each day or will they just put priority on anyone who has a TrueNet box? ...at which point I'll just tell my customers to pay TrueNet for a box to get the best service from their ISP.

D




Promote New Zealand - Get yourself a .kiwi.nz domain name!!!

Check out mine - i.am.a.can.do.kiwi.nz - don@i.am.a.can.do.kiwi.nz


freitasm

BDFL - Memuneh
80729 posts

Uber Geek
+1 received by user: 41179

Administrator
ID Verified
Trusted
Geekzone
Lifetime subscriber

  #419424 20-Dec-2010 13:46
Send private message

Behodar: "The reference website used to test caching has been changed for this reporting period. The change was necessary to remove the impact of 'special' caching undertaken by some ISPs for the otherwise rarely used website previously used as a reference. To avoid similar issues in the future, the new reference website will not be named."


Interesting... In Appendix I (page 23) they show a diagram and AirNZ as the "website server". I wonder if this was the previous test site, or the new one?

 




Referral links: Quic Broadband (free setup code: R587125ERQ6VE) | Samsung | AliExpress | Wise | Sharesies 

 

Support Geekzone by subscribing (browse ads-free), or making a one-off or recurring donation through PressPatron.

 


wongtop
569 posts

Ultimate Geek
+1 received by user: 50


  #419434 20-Dec-2010 14:02
Send private message

Anyone know who ISP3 is?

 
 
 

Shop now at Mighty Ape (affiliate link).
savag3
188 posts

Master Geek
+1 received by user: 3


  #419455 20-Dec-2010 14:33
Send private message

Not naming a whole lot of the ISP's in the report is just plain stupid. Especially since once of them is at the bottom of the International performance and variability results. I am sure their customers would like to know who it is.

Talkiet
4819 posts

Uber Geek
+1 received by user: 3935

Trusted

  #419460 20-Dec-2010 14:47
Send private message

savag3: Not naming a whole lot of the ISP's in the report is just plain stupid. Especially since once of them is at the bottom of the International performance and variability results. I am sure their customers would like to know who it is.


While I have a number of issues with the Epitiro methodology, reports and conclusions - I actually can support them on this decision...

Imagine you have an ISP that only has a single monitored connection, located say, in Auckland. It's highly likely that (all else being equal), that ISP would show up as being significantly better than the national averages of the other ISPs.

Conversely, if there is a boutique ISP in Invercargill that's monitored, even if they have awesome performance, they'll never perform as well as an Auckland based ISP because of the extra latency etc added between Akl and Invers.

Sure in isolated instances, where an un-named ISP has apparently bad performance, it would be nice to know who it is, 99.9% of people in NZ wouldn't understand the required context to accurately interpret what the result actually means.

Cheers - N





Please note all comments are from my own brain and don't necessarily represent the position or opinions of my employer, previous employers, colleagues, friends or pets.


richms
29124 posts

Uber Geek
+1 received by user: 10241

Trusted
Lifetime subscriber

  #419541 20-Dec-2010 17:01
Send private message

The reported methods are stupid IMO.

the report:
The benchmark DSL line synchronisation speed from the Central City site was relatively high at 8.1Mbps


Ah, no, in a place targeting adsl2+ speeds, that is relatively LOW

"web browsting speed" - WTF does that mean? I certainly dont care how many megabits I get when browsing, I care about other things.

Testing the pop and smtp speeds of ISPs? Does anyone use their ISP for email anymore?

For gods sake, do some useful tests please.

Try various bitrates of RTP streams from international and report the loss.

Try sustained low bitrate http like shoutcast and report on the latency, dropouts, reconnects, etc since some caching infrastructres tend to kill connections off after a while.

Report buffering times for some HD videos from a variety of online video sharing sites

Test performance and manipulation of bittorrent etc.

Test a skype call with high video resoultion etc, report on the amount of frames etc transfered.

Start using the connection for one service like torrent and test how it affects other services like http browsing.

IMO, reporting on the bitrate of web browsing as the primary factor would be like top gear reviewing a sports car and reporting the time taken to get in it and drive to the dairy and pickup a bottle of milk - Totally wrong testing for what is supposed to be a high performance machine.




Richard rich.ms

freitasm

BDFL - Memuneh
80729 posts

Uber Geek
+1 received by user: 41179

Administrator
ID Verified
Trusted
Geekzone
Lifetime subscriber

  #419551 20-Dec-2010 17:09
Send private message

richms: Testing the pop and smtp speeds of ISPs? Does anyone use their ISP for email anymore?


Yes, they do. And what's even more surprising is the number of companies with websites, and their Contact Us address is something @xtra.co.nz...

It makes a little LOLCAT die a bit every time I see this happening...

 




Referral links: Quic Broadband (free setup code: R587125ERQ6VE) | Samsung | AliExpress | Wise | Sharesies 

 

Support Geekzone by subscribing (browse ads-free), or making a one-off or recurring donation through PressPatron.

 


 1 | 2
View this topic in a long page with up to 500 replies per page Create new topic








Geekzone Live »

Try automatic live updates from Geekzone directly in your browser, without refreshing the page, with Geekzone Live now.



Are you subscribed to our RSS feed? You can download the latest headlines and summaries from our stories directly to your computer or smartphone by using a feed reader.