Was there ever a replacement for Truenet ISP performance measurement?

Forums › New Zealand Broadband › Was there ever a replacement for Truenet ISP performance measurement?

surfisup1000

5288 posts

Uber Geek

#251206 13-Jun-2019 11:21

Looking at changing ISP... truenet is gone, supposed to be replaced by https://www.measuringbroadbandnewzealand.com (i think?).

But, that website has only a single report for 2018.

Why would they replace truenet without ensuring a working replacement ?

Can't tell who is the best performing ISP now.

This is government funded so someone is getting money for a service that is not working.

1 | 2

152 posts

Master Geek

#2257297 13-Jun-2019 11:25

True Net has been replaced by SamKnows. There's a new report out today: https://comcom.govt.nz/news-and-media/media-releases/2019/nz-broadband-is-delivering-a-great-video-streaming-experience-for-consumers

sbiddle

30853 posts

Uber Geek

Retired Mod

Trusted

Biddle Corp

Lifetime subscriber

#2257298 13-Jun-2019 11:25

Samknows is the Govt funded replacement.

Its data so far seems pretty meaningless and the first data drop came on the 24th Dec so nobody noticed it or questioned it..

hio77

12999 posts

Uber Geek

ID Verified

Trusted

Lizard Networks

#2257311 13-Jun-2019 11:46

i've seen some of the probes looking quite nice now...

#include <std_disclaimer>

Any comments made are personal opinion and do not reflect directly on the position my current or past employers may have.

surfisup1000

5288 posts

Uber Geek

#2257340 13-Jun-2019 12:13

Thanks for the replies. This still seems unsatisfactory, where are the monthly reports like with truenet?

KrazyKid

1238 posts

Uber Geek

#2257383 13-Jun-2019 13:18

This seems to be the actual report rather than the media release.

https://comcom.govt.nz/__data/assets/pdf_file/0021/153543/MBNZ-Autumn-2019-report-13-June-2019.PDF

surfisup1000

5288 posts

Uber Geek

#2257389 13-Jun-2019 13:27

KrazyKid:

This seems to be the actual report rather than the media release.

https://comcom.govt.nz/__data/assets/pdf_file/0021/153543/MBNZ-Autumn-2019-report-13-June-2019.PDF

I really need to see per-ISP figures. They say it is coming....

KrazyKid

1238 posts

Uber Geek

#2257391 13-Jun-2019 13:30

I agree - the detailed report was general and not that useful in the scheme of things

Cloud spending continues to surge globally, but most organisations haven’t made the changes necessary to maximise the value and cost-efficiency benefits of their cloud investments. Download the whitepaper From Overspend to Advantage now.

cbrpilot

955 posts

Ultimate Geek

Trusted

Spark NZ

#2259317 17-Jun-2019 09:37

Samknows have not been doing RSP comparisons until they have a statistically significant number of probes per Access Type per RSP.

My views are my own, and may not necessarily represent those of my employer.

Talkiet

4792 posts

Uber Geek

Trusted

#2259401 17-Jun-2019 11:23

cbrpilot:

Samknows have not been doing RSP comparisons until they have a statistically significant number of probes per Access Type per RSP.

Yep. Samknows and the Comcom presented the plans for their testing to the industry some time ago and have been great at engagement with the RSPs since then. As Dave mentions, one of the things that came across early was that they would not be reporting per RSP stats or comparisons (or in fact comparisons on any metric) unless Samknows were confident of the data from a methodological AND STATISTICAL point of view.

This is one of the huge improvements over Truenet - instead of commentary and comparisons on statistically non significant or methodologically flawed data - Samknows are introducing results and comparisons AS THE DATA SUPPORTS THEM.

While no system is perfect, and there are a few small things to address - I have to say (as a network engineer and someone that has done postgrad stats and methodological design) I am very impressed with the collection and reporting of data so far.

TL;DR. What Dave said, not enough data yet to make supportable claims.

Cheers -N

Please note all comments are from my own brain and don't necessarily represent the position or opinions of my employer, previous employers, colleagues, friends or pets.

surfisup1000

5288 posts

Uber Geek

#2259430 17-Jun-2019 12:46

Talkiet:

TL;DR. What Dave said, not enough data yet to make supportable claims.

Cheers -N

So when will they actually produce useful data then?

Talkiet

4792 posts

Uber Geek

Trusted

#2259437 17-Jun-2019 12:50

I think that the data is already useful. As for when they may have data showing between RSP comparisons - that's going to be based on things I don't have knowledge of.

Cheers - N

Please note all comments are from my own brain and don't necessarily represent the position or opinions of my employer, previous employers, colleagues, friends or pets.

surfisup1000

5288 posts

Uber Geek

#2259453 17-Jun-2019 13:16

Talkiet:

I think that the data is already useful. As for when they may have data showing between RSP comparisons - that's going to be based on things I don't have knowledge of.

Cheers - N

This is from the comcom site...

"The aim of the monitoring programme is to provide consumers with independent information on broadband performance across different providers, plans and technologies, to help them choose the best broadband for their household."

The data according to the stated aim is not useful at all.

Talkiet

4792 posts

Uber Geek

Trusted

#2259462 17-Jun-2019 13:38

The data at the moment does show differences across plans and technologies. I know you already know what plan and technology is best for you, but you're not the target market are you?

Because the one comparison you want doesn't exist yet doesn't make the data "not useful at all".

Cheers - N

Please note all comments are from my own brain and don't necessarily represent the position or opinions of my employer, previous employers, colleagues, friends or pets.

surfisup1000

5288 posts

Uber Geek

#2260455 18-Jun-2019 18:54

Talkiet:

The data at the moment does show differences across plans and technologies. I know you already know what plan and technology is best for you, but you're not the target market are you?

Because the one comparison you want doesn't exist yet doesn't make the data "not useful at all".

Cheers - N

Most semi-literate consumers already know fibre is faster than dsl. In the same way that it is not necessary to have a report tell us that fibre 1000 is faster than fiber100.

The primary comparison that most consumers want is whether your current provider is giving a rubbish service and a list of the best alternative providers.

I find it strange you cannot see that.

hio77

12999 posts

Uber Geek

ID Verified

Trusted

Lizard Networks

#2260459 18-Jun-2019 19:05

Things like packet loss. Real world performance etc is still interesting. And often slightly more telling.

The way I read into the vdsl results, they lack vectored connections and most are low end connections.

#include <std_disclaimer>

Any comments made are personal opinion and do not reflect directly on the position my current or past employers may have.

1 | 2

surfisup1000

howdystranger

sbiddle

hio77

surfisup1000

KrazyKid

surfisup1000

KrazyKid

Equinox IT

cbrpilot

Talkiet

surfisup1000

Talkiet

surfisup1000

Talkiet

surfisup1000

hio77