Geekzone: technology news, blogs, forums
Guest
Welcome Guest.
You haven't logged in yet. If you don't have an account you can register now.

View this topic in a long page with up to 500 replies per page Create new topic
1 | 2 | 3


1217 posts

Uber Geek
+1 received by user: 118

Trusted

  Reply # 731646 12-Dec-2012 22:26 Send private message

I guess the point that SideFX is making is that he can't be sure that this is pure international bandwidth from his particular test source.

1082 posts

Uber Geek
+1 received by user: 47


  Reply # 731648 12-Dec-2012 22:30 Send private message

SamF: I guess the point that SideFX is making is that he can't be sure that this is pure international bandwidth from his particular test source.


That he's getting 30 megabit on an international download in peak time with a single thread.

Sure I'd love to say that 30 megabit single threaded performance should be the norm, but it's just not realistic.

Maybe to Los Angeles hosts you may peak around there.

One thing that can happen with high speed downloads is there's a lot of collection collapse type stuff as you start moving into those faster speeds where speed can start to go up then suddenly collapse in speed.  If you watch a single thread you can see the effect.  Sometimes reducing window size can help reduce the chances of that collapsing.

Basically from what I understand this is because various queues end up being too short and can't take the burst of new packets, and drop, giving sudden tcp/ip speed drops.  There's a few things in very recent Linux versions that can help if the server runs recent Linux version, but a lot of servers are infrequently updated. (client side changes aren't needed in this case)


1851 posts

Uber Geek
+1 received by user: 244


  Reply # 731653 12-Dec-2012 22:33 Send private message

mercutio: 
1 megabyte/sec is reasonable on a high speed connection for uncached international content.

Sure I'd love to get consistent line rate everywhere, no packet loss, no delays, etc etc, but it's reasonably comparable to what a lot of other people around the world experience.

If the caching actually caches stuff that you want to download, and you get fast speeds then surely it's a good thing, and it's working as intended.


Yeah absolutely, just to be clear I'm completely happy with both rates. And I have no issue with caching - indeed it's very useful. But as above, essentially my point is just that getting 3.5-4 MB/s  to US East coast Servers on speedtest and single threaded file downloads seems too good to be true ;-)



1217 posts

Uber Geek
+1 received by user: 118

Trusted

  Reply # 731655 12-Dec-2012 22:36 Send private message

Right, well, to be honest, I've never seen ANY download from ANYWHERE get even close to 30mbit on a single thread.

I just tested a popular locally Akamai cached file from Microsoft just now; 500kbytes/sec max. Overall speed also depends on how much speed the remote server is allowing per connection too.

TBH, I'm not quite sure what everyone's concern is about single threaded downloads.

1082 posts

Uber Geek
+1 received by user: 47


  Reply # 731657 12-Dec-2012 22:43 Send private message

SamF: Right, well, to be honest, I've never seen ANY download from ANYWHERE get even close to 30mbit on a single thread.

I just tested a popular locally Akamai cached file from Microsoft just now; 500kbytes/sec max. Overall speed also depends on how much speed the remote server is allowing per connection too.

TBH, I'm not quite sure what everyone's concern is about single threaded downloads.


multithreading is bad :)

Try: http://cachefly.cachefly.net/100mb.test for a good speed test.  It's Australia, fast connection.  They're much better than Akamai, you don't have the low hit rate problem.




1217 posts

Uber Geek
+1 received by user: 118

Trusted

  Reply # 731660 12-Dec-2012 22:47 Send private message

Lol, why do you say multithreading is bad?

I've heard the argument that using multiple threads is 'selfish' because you use more bandwidth than other users, but I don't buy that. If I use 10 threads instead of 1, sure I use 10x more bandwidth than others, BUT I'm finished 10x faster than everyone else, so the net bandwidth usage over time is exactly the same!

Yeah, that 100mb test file came down at 3.5MB/sec so not bad. Obviously that server has less (or no) restriction on per connection speeds.

1851 posts

Uber Geek
+1 received by user: 244


  Reply # 731662 12-Dec-2012 22:50 Send private message

Nothing wrong with multithreading - wget (single thread) was just convenient to see if it was achieving higher rates than I would have expected :)

1082 posts

Uber Geek
+1 received by user: 47


  Reply # 731670 12-Dec-2012 23:07 Send private message

SamF: Lol, why do you say multithreading is bad?

I've heard the argument that using multiple threads is 'selfish' because you use more bandwidth than other users, but I don't buy that. If I use 10 threads instead of 1, sure I use 10x more bandwidth than others, BUT I'm finished 10x faster than everyone else, so the net bandwidth usage over time is exactly the same!

Yeah, that 100mb test file came down at 3.5MB/sec so not bad. Obviously that server has less (or no) restriction on per connection speeds.


Multithreading means that you can get erratic and unstable transfers, giving strong bursts of packets often getting dropped, wasting network traffic/bandwidth, encouraging people to do complicated weird shaping to maintain adequete performance, meaning casual web browsing ends up doing retransmits on normal web pages.

That said, it used to be that a lot of servers didn't have big enough window sizes for fast connections, so it was necessary, and now some providers like cogent and telstraglobal drop enough packets that you really need to to get good transfer speeds.

If you are going to multithread, it's best to not use more than is necessary, ie if you get 800k/sec then using 5 threads should be adequete, although i reckon 4 is more fair.

The net bandwidth usage over time actually increases the closer you are to your line rate.  Leading to either buffering or dropping packets.

It'd be a lot better when can just get decent speeds with single connection.



1217 posts

Uber Geek
+1 received by user: 118

Trusted

  Reply # 731672 12-Dec-2012 23:14 Send private message

For sure, obviously less threads is better than more, but I'm not so sure that there's that much more overhead. My multithreaded transfers tend to run very smoothly. I have done quite a bit of work to get them like that of course, but it is possible to do efficiently.

1082 posts

Uber Geek
+1 received by user: 47


  Reply # 731673 12-Dec-2012 23:15 Send private message

SamF: For sure, obviously less threads is better than more, but I'm not so sure that there's that much more overhead. My multithreaded transfers tend to run very smoothly. I have done quite a bit of work to get them like that of course, but it is possible to do efficiently.


Do you have your own server that you're downloading from?  If so I'd be curious what data volumes server sends out compared to what you receive.




1217 posts

Uber Geek
+1 received by user: 118

Trusted

  Reply # 731674 12-Dec-2012 23:18 Send private message

Naa, I'm testing from a Usenet server.

1082 posts

Uber Geek
+1 received by user: 47


  Reply # 731680 12-Dec-2012 23:20 Send private message

SamF: Naa, I'm testing from a Usenet server.


West coast?  Shouldn't need 10 threads for west coast.



1217 posts

Uber Geek
+1 received by user: 118

Trusted

  Reply # 731681 12-Dec-2012 23:21 Send private message

Not exactly sure where it is TBH.

84 posts

Master Geek
+1 received by user: 2


  Reply # 731697 13-Dec-2012 00:26 Send private message

There was an item about Snap in yesterdays(Wed 12/12) Christchurch Press.

Said that Snap had directly rented a slice of the Southern Cross Cable.

Maybe that is the reason foe WOW speeds to the land of the free and the home of the brave.



1217 posts

Uber Geek
+1 received by user: 118

Trusted

  Reply # 731699 13-Dec-2012 00:32 Send private message

Hmm, interesting! Maybe you're right!

Is there an online version of the article?

1 | 2 | 3
View this topic in a long page with up to 500 replies per page Create new topic

Twitter »
Follow us to receive Twitter updates when new discussions are posted in our forums:



Follow us to receive Twitter updates when news items and blogs are posted in our frontpage:



Follow us to receive Twitter updates when tech item prices are listed in our price comparison site:





Trending now »

Hot discussions in our forums right now:

Speed limit when overtaking? Teach me please.
Created by nakedmolerat, last reply by joker97 on 25-Oct-2014 16:26 (83 replies)
Pages... 4 5 6


House Auctions
Created by t0ny, last reply by mattwnz on 25-Oct-2014 00:18 (36 replies)
Pages... 2 3


Neon - Sky's new streaming service
Created by JarrodM, last reply by myfullflavour on 25-Oct-2014 12:39 (28 replies)
Pages... 2


VDSL, which router/modem sub $200?
Created by TeaLeaf, last reply by NonprayingMantis on 25-Oct-2014 14:46 (24 replies)
Pages... 2


iPad Air 2 and iPad Mini 3. Gonna get one?
Created by Dingbatt, last reply by alasta on 25-Oct-2014 12:30 (114 replies)
Pages... 6 7 8


5Ghz AP recommendations?
Created by ubergeeknz, last reply by sbiddle on 24-Oct-2014 12:42 (12 replies)

Snap have failed our company!
Created by dafman, last reply by kornflake on 23-Oct-2014 17:41 (37 replies)
Pages... 2 3


Thief taunts 12 year old via stolen laptop
Created by macuser, last reply by charsleysa on 22-Oct-2014 23:49 (12 replies)


Geekzone Live »

Try automatic live updates from Geekzone directly in your browser, without refreshing the page, with Geekzone Live now.

Are you subscribed to our RSS feed? You can download the latest headlines and summaries from our stories directly to your computer or smartphone by using a feed reader.

Alternatively, you can receive a daily email with Geekzone updates.