2degrees AWS issues

Forums › 2degrees (including Slingshot, Orcon, Flip, Stuff Fibre, MyRepublic, 2talk and Vocus) › 2degrees AWS issues

TheoM

229 posts

Master Geek
+1 received by user: 55

ID Verified

Trusted

#250778 24-May-2019 20:51

Hey GZers!

I'm seeing incredibly slow download speeds (30-40KB/s) to the GitHub production S3 buckets. Is anyone else with 2degrees able to replicate this when downloading this zip?

Hi! I'm TheoM, but you know that already. I run Linux mirrors in NZ together with 2degrees. Like a mirror added? PM me!

https://theom.co.nz | https://theom.nz | https://mirrorlist.mirrors.theom.nz | Providing Free Mirrors Since Ages Ago™

dfnt

1553 posts

Uber Geek
+1 received by user: 1036

Trusted

Lifetime subscriber

#2245036 24-May-2019 21:10

Incredibly slow

aria2-1.34.0-win-64bit-build1.zip 100%[=========================================================================================================================================>] 2.00M 20.3KB/s in 2m 10s

2019-05-24 21:10:37 (15.8 KB/s) - ‘aria2-1.34.0-win-64bit-build1.zip’ saved [2102204/2102204]

Linux

12182 posts

Uber Geek
+1 received by user: 8476

Trusted

Lifetime subscriber

#2245038 24-May-2019 21:13

@NickMack

NickMack

977 posts

Ultimate Geek
+1 received by user: 831

Trusted

In memoriam

Lifetime subscriber

#2245039 24-May-2019 21:17

Hideously slow... It's left our network at Equinix in Sydney - Most definitely not a capacity issue on our side, we added 20GB Trans-Tasman today.

Nick.

https://nick.mackechnie.co.nz | NZ ISP latency monitoring - https://smokeping.thenet.gen.nz

timmmay

20858 posts

Uber Geek
+1 received by user: 5350

Trusted

Lifetime subscriber

#2245044 24-May-2019 21:23

Yes, about 100kbps. That's not an S3 URL, so unless it redirects it could be being proxied.

I uploaded an 80Mb object (file) to two buckets. I downloaded from Sydney at 30Mbps, and from Oregon at 20Mbps. That suggests S3 is working fine in those regions.

AWS service status is all green. I'd probably look at that URL / download some more before pointing the finger at S3.

timmmay

20858 posts

Uber Geek
+1 received by user: 5350

Trusted

Lifetime subscriber

#2245045 24-May-2019 21:24

NickMack:

Hideously slow... It's left our network at Equinix in Sydney - Most definitely not a capacity issue on our side, we added 20GB Trans-Tasman today.

Nick.

I guess then it's either Sydney hosted or using AWS transfer acceleration. Or I guess it could be going anywhere from Equinix. I just know Equinix is one of the two peering points AWS uses in Sydney.

TheoM

229 posts

Master Geek
+1 received by user: 55

ID Verified

Trusted

#2245046 24-May-2019 21:25

timmmay:

Yes, about 100kbps. That's not an S3 URL, so unless it redirects it could be being proxied.

I uploaded an 80Mb object (file) to two buckets. I downloaded from Sydney at 30Mbps, and from Oregon at 20Mbps. That suggests S3 is working fine in those regions.

AWS service status is all green. I'd probably look at that URL / download some more before pointing the finger at S3.

It's not, until GitHub pushes you toward one of their S3 buckets. GitHub LFS ftw. Highly unlikely it would be S3, though it could be the GitHub buckets being hammered

Hi! I'm TheoM, but you know that already. I run Linux mirrors in NZ together with 2degrees. Like a mirror added? PM me!

https://theom.co.nz | https://theom.nz | https://mirrorlist.mirrors.theom.nz | Providing Free Mirrors Since Ages Ago™

Samsung

Shop now on Samsung phones, tablets, TVs and more (affiliate link).

timmmay

20858 posts

Uber Geek
+1 received by user: 5350

Trusted

Lifetime subscriber

#2245047 24-May-2019 21:35

S3 doesn't allocate been with all resources at the bucket level so you can't really exhaust bucket capacity. Buckets could have tens of terabits of downloads without any significant problem.

timmmay

20858 posts

Uber Geek
+1 received by user: 5350

Trusted

Lifetime subscriber

#2245053 24-May-2019 21:47

You can overwhelm S3 but I think it would have to be a sudden large volume of requests for a single object. If it ramps up S3 just scales out to almost any load, and they can offload globally if either you pay for it or they choose to.

AWS bandwidth is expensive though.

michaelmurfy

meow
13579 posts

Uber Geek
+1 received by user: 10910

Moderator

ID Verified

Trusted

Lifetime subscriber

#2245096 25-May-2019 01:16

Looks to be resolved now.

Michael Murphy | https://murfy.nz
Referral Links: Quic Broadband (use R122101E7CV7Q for free setup)

Are you happy with what you get from Geekzone? Please consider supporting us by subscribing.
Opinions are my own and not the views of my employer.

TheoM

229 posts

Master Geek
+1 received by user: 55

ID Verified

Trusted

#2245098 25-May-2019 01:33

michaelmurfy:

Looks to be resolved now.

Not entirely, speeds for me are still hovering in the 80-100KB/s range. Hopefully by the morning

Hi! I'm TheoM, but you know that already. I run Linux mirrors in NZ together with 2degrees. Like a mirror added? PM me!

https://theom.co.nz | https://theom.nz | https://mirrorlist.mirrors.theom.nz | Providing Free Mirrors Since Ages Ago™

rugrat

3142 posts

Uber Geek
+1 received by user: 944

Lifetime subscriber

#2245102 25-May-2019 02:13

It downloaded in 3 to 4 seconds for me. 2degrees Christchurch.

Started download, clicked on download arrow on Firefox to see speed, and it was already downloaded. 2053KB file

New World

Shop on-line at New World now for your groceries (affiliate link).

richms

29099 posts

Uber Geek
+1 received by user: 10209

Trusted

Lifetime subscriber

#2245103 25-May-2019 02:42

I was trying to download retropie again because my nas is off which has the image on it and I thought downloading again would be better than going to the shed to turn it back on in this cold.

I was getting this trash speed.

And I am on voyager not 2degrees. It seems to have finished ok on the second try but I will download it again to be sure.

Edit: tried again and it started off ok and was saying 2 mins to go and 55MB/sec, got half way and the speed tanked to 1.5-3 with it going up and down like crazy.

Richard rich.ms

richms

29099 posts

Uber Geek
+1 received by user: 10209

Trusted

Lifetime subscriber

#2245381 25-May-2019 14:01

Any good for anyone else yet?

Fiber has spoiled me and I cant tollerate this wait to get a file that github or amazon are subjecting me to!

Richard rich.ms

Tracer

343 posts

Ultimate Geek
+1 received by user: 151

#2245411 25-May-2019 14:39

richms:

I was trying to download retropie again because my nas is off which has the image on it and I thought downloading again would be better than going to the shed to turn it back on in this cold.

I was getting this trash speed.

And I am on voyager not 2degrees. It seems to have finished ok on the second try but I will download it again to be sure.

Edit: tried again and it started off ok and was saying 2 mins to go and 55MB/sec, got half way and the speed tanked to 1.5-3 with it going up and down like crazy.

Most distros offer torrents. They're generally a lot faster even when you don't have these issues.

timmmay

20858 posts

Uber Geek
+1 received by user: 5350

Trusted

Lifetime subscriber

#2245448 25-May-2019 17:04

S3 can automatically generate a torrent for any file, but that's not much use if the torrent isn't published and widely used.