freitasm:ahmad: I don't think the methodology is particularly flawed because the limitations are well recognised. I'm just looking at how to do the best job possible.
The limitations are well recognised by you, me and others here. But John Doe on the street uses an iPhone and every time it fails he blames the network, when we know here the handset itself has some problems...
With respect, the report I published last August when I first tested was titled:
"XT Faster in More Dunedin Places for iPhone 3G"
One of the summary statements in conclusion was:
"It is clear from these tests that as of 7 August 2009, an iPhone runs “faster in more Dunedin places”.
I'm pretty sure I made it clear to John Doe and if JD is one to use my report to say "see - XT is better than Vodafone 3G", then he's going to come to that conclusion regardless of whether I publish a report or not.