Was there ever a replacement for Truenet ISP performance measurement?

Forums › New Zealand Broadband › Was there ever a replacement for Truenet ISP performance measurement?

surfisup1000

4269 posts

Uber Geek
+1 received by user: 1466

# 251206 13-Jun-2019 11:21

Looking at changing ISP... truenet is gone, supposed to be replaced by https://www.measuringbroadbandnewzealand.com (i think?).

But, that website has only a single report for 2018.

Why would they replace truenet without ensuring a working replacement ?

Can't tell who is the best performing ISP now.

This is government funded so someone is getting money for a service that is not working.

1 | 2

132 posts

Master Geek
+1 received by user: 27

Subscriber

# 2257297 13-Jun-2019 11:25

True Net has been replaced by SamKnows. There's a new report out today: https://comcom.govt.nz/news-and-media/media-releases/2019/nz-broadband-is-delivering-a-great-video-streaming-experience-for-consumers

sbiddle

27989 posts

Uber Geek
+1 received by user: 7470

Moderator

Trusted

Biddle Corp

Lifetime subscriber

# 2257298 13-Jun-2019 11:25

Samknows is the Govt funded replacement.

Its data so far seems pretty meaningless and the first data drop came on the 24th Dec so nobody noticed it or questioned it..

hio77

'That VDSL Cat'
10507 posts

Uber Geek
+1 received by user: 2526

Trusted

Spark

Subscriber

# 2257311 13-Jun-2019 11:46

i've seen some of the probes looking quite nice now...

#include <std_disclaimer>

Any comments made are personal opinion and do not reflect directly on the position my current or past employers may have.

surfisup1000

4269 posts

Uber Geek
+1 received by user: 1466

# 2257340 13-Jun-2019 12:13

Thanks for the replies. This still seems unsatisfactory, where are the monthly reports like with truenet?

KrazyKid

741 posts

Ultimate Geek
+1 received by user: 215

# 2257383 13-Jun-2019 13:18

This seems to be the actual report rather than the media release.

https://comcom.govt.nz/__data/assets/pdf_file/0021/153543/MBNZ-Autumn-2019-report-13-June-2019.PDF

surfisup1000

4269 posts

Uber Geek
+1 received by user: 1466

# 2257389 13-Jun-2019 13:27

KrazyKid:

This seems to be the actual report rather than the media release.

https://comcom.govt.nz/__data/assets/pdf_file/0021/153543/MBNZ-Autumn-2019-report-13-June-2019.PDF

I really need to see per-ISP figures. They say it is coming....

KrazyKid

741 posts

Ultimate Geek
+1 received by user: 215

# 2257391 13-Jun-2019 13:30

I agree - the detailed report was general and not that useful in the scheme of things

cbrpilot

712 posts

Ultimate Geek
+1 received by user: 272

Trusted

Spark NZ

# 2259317 17-Jun-2019 09:37

2 people support this post

Samknows have not been doing RSP comparisons until they have a statistically significant number of probes per Access Type per RSP.

My views are my own, and may not necessarily represent those of my employer.

Talkiet

4123 posts

Uber Geek
+1 received by user: 2879

Trusted

# 2259401 17-Jun-2019 11:23

One person supports this post

cbrpilot:

Samknows have not been doing RSP comparisons until they have a statistically significant number of probes per Access Type per RSP.

Yep. Samknows and the Comcom presented the plans for their testing to the industry some time ago and have been great at engagement with the RSPs since then. As Dave mentions, one of the things that came across early was that they would not be reporting per RSP stats or comparisons (or in fact comparisons on any metric) unless Samknows were confident of the data from a methodological AND STATISTICAL point of view.

This is one of the huge improvements over Truenet - instead of commentary and comparisons on statistically non significant or methodologically flawed data - Samknows are introducing results and comparisons AS THE DATA SUPPORTS THEM.

While no system is perfect, and there are a few small things to address - I have to say (as a network engineer and someone that has done postgrad stats and methodological design) I am very impressed with the collection and reporting of data so far.

TL;DR. What Dave said, not enough data yet to make supportable claims.

Cheers -N

Please note all comments are the product of my own brain and don't necessarily represent the position or opinions of my employer, previous employers, colleagues, friends or pets.

surfisup1000

4269 posts

Uber Geek
+1 received by user: 1466

# 2259430 17-Jun-2019 12:46

One person supports this post

Talkiet:

TL;DR. What Dave said, not enough data yet to make supportable claims.

Cheers -N

So when will they actually produce useful data then?

Talkiet

4123 posts

Uber Geek
+1 received by user: 2879

Trusted

# 2259437 17-Jun-2019 12:50

One person supports this post

I think that the data is already useful. As for when they may have data showing between RSP comparisons - that's going to be based on things I don't have knowledge of.

Cheers - N

Please note all comments are the product of my own brain and don't necessarily represent the position or opinions of my employer, previous employers, colleagues, friends or pets.

surfisup1000

4269 posts

Uber Geek
+1 received by user: 1466

# 2259453 17-Jun-2019 13:16

2 people support this post

Talkiet:

I think that the data is already useful. As for when they may have data showing between RSP comparisons - that's going to be based on things I don't have knowledge of.

Cheers - N

This is from the comcom site...

"The aim of the monitoring programme is to provide consumers with independent information on broadband performance across different providers, plans and technologies, to help them choose the best broadband for their household."

The data according to the stated aim is not useful at all.

Talkiet

4123 posts

Uber Geek
+1 received by user: 2879

Trusted

# 2259462 17-Jun-2019 13:38

2 people support this post

The data at the moment does show differences across plans and technologies. I know you already know what plan and technology is best for you, but you're not the target market are you?

Because the one comparison you want doesn't exist yet doesn't make the data "not useful at all".

Cheers - N

Please note all comments are the product of my own brain and don't necessarily represent the position or opinions of my employer, previous employers, colleagues, friends or pets.

surfisup1000

4269 posts

Uber Geek
+1 received by user: 1466

# 2260455 18-Jun-2019 18:54

One person supports this post

Talkiet:

The data at the moment does show differences across plans and technologies. I know you already know what plan and technology is best for you, but you're not the target market are you?

Because the one comparison you want doesn't exist yet doesn't make the data "not useful at all".

Cheers - N

Most semi-literate consumers already know fibre is faster than dsl. In the same way that it is not necessary to have a report tell us that fibre 1000 is faster than fiber100.

The primary comparison that most consumers want is whether your current provider is giving a rubbish service and a list of the best alternative providers.

I find it strange you cannot see that.

hio77

'That VDSL Cat'
10507 posts

Uber Geek
+1 received by user: 2526

Trusted

Spark

Subscriber

# 2260459 18-Jun-2019 19:05

Things like packet loss. Real world performance etc is still interesting. And often slightly more telling.

The way I read into the vdsl results, they lack vectored connections and most are low end connections.

#include <std_disclaimer>

Any comments made are personal opinion and do not reflect directly on the position my current or past employers may have.

1 | 2