gchiu: And how long does the testing carry on for?   A few months?  Longer?

maverick: Any more thoughts from Truenet on my comments ?

gchiu: Postal services are being run down due to diminishing use ... no doubt letters will turn up!

JohnButt:

maverick: Any more thoughts from Truenet on my comments ?

Interesting comment that you make comparing 2Talk with VFX (I presume) saying 2Talk is one of your "flyby nighters" and VFX as a "carrier grade VoIP network".  

We are keen to provide test results that show the performance difference between suppliers, based on fair and reasonable measurements, hence our discussion.   We are also keen to incorporate your great ideas.

As we have done in the fixed line broadband results, we compare service with service. VoIP is a voice (& video) connection service and it should be fairly measured by us, independent of how the service is built.  If we can we will also compare with POTS voice services.

More ideas on methodology would be great. 

jtbthatsme: Just wondering I'm currently in Wellington South but at the end of this year would be living in the Lower Hutt area is this a problem if I voluteer I do not see myself changing from WXC as a ISP as they do provide a reliable mostly cost effective (for my needs) service for both data and VOIP.

maverick:

JohnButt:

maverick: Any more thoughts from Truenet on my comments ?

Interesting comment that you make comparing 2Talk with VFX (I presume) saying 2Talk is one of your "flyby nighters" and VFX as a "carrier grade VoIP network".  

We are keen to provide test results that show the performance difference between suppliers, based on fair and reasonable measurements, hence our discussion.   We are also keen to incorporate your great ideas.

As we have done in the fixed line broadband results, we compare service with service. VoIP is a voice (& video) connection service and it should be fairly measured by us, independent of how the service is built.  If we can we will also compare with POTS voice services.

More ideas on methodology would be great. 

Not at all with 2talk they are not a "flyby nighter"at all, they have a great little Asterisk based system provided by Ray and Jude who give a great feature rich service , what they don't have as you are more than aware of is an underlying network to connect their customers directly to their voice services, they provide their service to customers into their network from various other providers access products which are going to getting to them via shared peering points.


Now this comment by you is interesting and a reason for my questions which you have now raised even more concerns after these remarks

"As we have done in the fixed line broadband results, we compare service with service. VoIP is a voice (& video) connection service and it should be fairly measured by us"

Fairly measured is the key factor here,you have no ability to fairly test a providers VoIP service with what you have listed as your test system as a true and reflective measure of a companies ability to deliver a VoIP over their own network,

Example being Ourselves, Vodafone, Orcon and Callplus have platforms and infrastructure where VoIP calls working natively with our respective platforms are handled vastly different than cross providers VoIP services , i.e a VFX hosted device off a Orcon LLU connection, yet from what you are saying this is what you will want to post your statistics around, I have major problems with that.

Primary Voice services being provided by the major VoIP players in the market have their own network deployed for a major reason and that is to give best quality VoIP experiences for our direct connected ISP customers as these are contained within their own network ,

Right now you have a couple of requests from some our FTTH users of which we have several thousand, now under your methodology you will test from these to your hosted platform and post the MOS results on WxC's ability to deliver VoIP services.... This is wrong and no way is a true reflection of the customers VoIP experience !!!!!, the VFX VoIP services deployed come into our network across the same network as your "test service" however from the time it leaves the device to the time it is handed off the RTP packets have been treated vastly differently than your random test packets which are lumped in with the best efforts traffic, so you say that the service should be fairly measured tell me how this is fair John ?

You will also find the same for the other providers who have a majority of the VoIP connections in NZ, so basically your stats are not looking at the majority of the deployed VoIP connections all your reporting on is a ability to transit RTP packets across shared peering links with no QOS or tagging,

So again my concern here is media and misinformation which you are going to supply in the public domain, you will report on this and post it here and other places i.e ComCom and the only thing the basic reader of these reports will understand is that you are measuring VoIP MOS statistics of different carriers, your average person is not going to understand how VLANing, QOS tagging works, all they will see a report saying this is the quality measurement for VoIP using Carrier A B or C which no way reflects that carriers VoIP offering...

Comparing fixed line testing of a ISP and testing VoIP offerings is vastly different and again I have concerns over your methodology described here and I believe if you cant measure it "Fairly and accurately" there is no way I would want you putting these results against WxC no matter good or bad as they are not a accurate reflection of how we handle the VFX voice service.