2degrees AWS issues

Forums › 2degrees (including Slingshot, Orcon, Flip, Stuff Fibre, MyRepublic, 2talk and Vocus) › 2degrees AWS issues

TheoM

228 posts

Master Geek

ID Verified

Trusted

#250778 24-May-2019 20:51

Hey GZers!

I'm seeing incredibly slow download speeds (30-40KB/s) to the GitHub production S3 buckets. Is anyone else with 2degrees able to replicate this when downloading this zip?

Hi! I'm TheoM, but you know that already. I run Linux mirrors in NZ together with 2degrees. Like a mirror added? PM me!

https://theom.co.nz | https://theom.nz | https://mirrorlist.mirrors.theom.nz | Providing Free Mirrors Since Ages Ago™

dfnt

1512 posts

Uber Geek

Lifetime subscriber

#2245036 24-May-2019 21:10

Incredibly slow

aria2-1.34.0-win-64bit-build1.zip 100%[=========================================================================================================================================>] 2.00M 20.3KB/s in 2m 10s

2019-05-24 21:10:37 (15.8 KB/s) - ‘aria2-1.34.0-win-64bit-build1.zip’ saved [2102204/2102204]

Linux

11424 posts

Uber Geek

Trusted

Lifetime subscriber

#2245038 24-May-2019 21:13

@NickMack

NickMack

962 posts

Ultimate Geek

Trusted

Lifetime subscriber

#2245039 24-May-2019 21:17

Hideously slow... It's left our network at Equinix in Sydney - Most definitely not a capacity issue on our side, we added 20GB Trans-Tasman today.

Nick.

https://nick.mackechnie.co.nz | NZ ISP latency monitoring - https://smokeping.thenet.gen.nz

timmmay

20580 posts

Uber Geek

Trusted

Lifetime subscriber

#2245044 24-May-2019 21:23

Yes, about 100kbps. That's not an S3 URL, so unless it redirects it could be being proxied.

I uploaded an 80Mb object (file) to two buckets. I downloaded from Sydney at 30Mbps, and from Oregon at 20Mbps. That suggests S3 is working fine in those regions.

AWS service status is all green. I'd probably look at that URL / download some more before pointing the finger at S3.

timmmay

20580 posts

Uber Geek

Trusted

Lifetime subscriber

#2245045 24-May-2019 21:24

NickMack:

Hideously slow... It's left our network at Equinix in Sydney - Most definitely not a capacity issue on our side, we added 20GB Trans-Tasman today.

Nick.

I guess then it's either Sydney hosted or using AWS transfer acceleration. Or I guess it could be going anywhere from Equinix. I just know Equinix is one of the two peering points AWS uses in Sydney.

TheoM

228 posts

Master Geek

ID Verified

Trusted

#2245046 24-May-2019 21:25

timmmay:

Yes, about 100kbps. That's not an S3 URL, so unless it redirects it could be being proxied.

I uploaded an 80Mb object (file) to two buckets. I downloaded from Sydney at 30Mbps, and from Oregon at 20Mbps. That suggests S3 is working fine in those regions.

AWS service status is all green. I'd probably look at that URL / download some more before pointing the finger at S3.

It's not, until GitHub pushes you toward one of their S3 buckets. GitHub LFS ftw. Highly unlikely it would be S3, though it could be the GitHub buckets being hammered

Hi! I'm TheoM, but you know that already. I run Linux mirrors in NZ together with 2degrees. Like a mirror added? PM me!

https://theom.co.nz | https://theom.nz | https://mirrorlist.mirrors.theom.nz | Providing Free Mirrors Since Ages Ago™

timmmay

20580 posts

Uber Geek

Trusted

Lifetime subscriber

#2245047 24-May-2019 21:35

S3 doesn't allocate been with all resources at the bucket level so you can't really exhaust bucket capacity. Buckets could have tens of terabits of downloads without any significant problem.

Equinox IT

Cloud spending continues to surge globally, but most organisations haven’t made the changes necessary to maximise the value and cost-efficiency benefits of their cloud investments. Download the whitepaper From Overspend to Advantage now.

timmmay

20580 posts

Uber Geek

Trusted

Lifetime subscriber

#2245053 24-May-2019 21:47

You can overwhelm S3 but I think it would have to be a sudden large volume of requests for a single object. If it ramps up S3 just scales out to almost any load, and they can offload globally if either you pay for it or they choose to.

AWS bandwidth is expensive though.

michaelmurfy

meow
13244 posts

Uber Geek

Moderator

ID Verified

Trusted

Lifetime subscriber

#2245096 25-May-2019 01:16

Looks to be resolved now.

Michael Murphy | https://murfy.nz
Referral Links: Quic Broadband (use R122101E7CV7Q for free setup)

Are you happy with what you get from Geekzone? Please consider supporting us by subscribing.
Opinions are my own and not the views of my employer.

TheoM

228 posts

Master Geek

ID Verified

Trusted

#2245098 25-May-2019 01:33

michaelmurfy:

Looks to be resolved now.

Not entirely, speeds for me are still hovering in the 80-100KB/s range. Hopefully by the morning

Hi! I'm TheoM, but you know that already. I run Linux mirrors in NZ together with 2degrees. Like a mirror added? PM me!

https://theom.co.nz | https://theom.nz | https://mirrorlist.mirrors.theom.nz | Providing Free Mirrors Since Ages Ago™

rugrat

3107 posts

Uber Geek

Lifetime subscriber

#2245102 25-May-2019 02:13

It downloaded in 3 to 4 seconds for me. 2degrees Christchurch.

Started download, clicked on download arrow on Firefox to see speed, and it was already downloaded. 2053KB file

richms

28176 posts

Uber Geek

Trusted

Lifetime subscriber

#2245103 25-May-2019 02:42

I was trying to download retropie again because my nas is off which has the image on it and I thought downloading again would be better than going to the shed to turn it back on in this cold.

I was getting this trash speed.

And I am on voyager not 2degrees. It seems to have finished ok on the second try but I will download it again to be sure.

Edit: tried again and it started off ok and was saying 2 mins to go and 55MB/sec, got half way and the speed tanked to 1.5-3 with it going up and down like crazy.

Richard rich.ms

richms

28176 posts

Uber Geek

Trusted

Lifetime subscriber

#2245381 25-May-2019 14:01

Any good for anyone else yet?

Fiber has spoiled me and I cant tollerate this wait to get a file that github or amazon are subjecting me to!

Richard rich.ms

Tracer

343 posts

Ultimate Geek

#2245411 25-May-2019 14:39

richms:

I was trying to download retropie again because my nas is off which has the image on it and I thought downloading again would be better than going to the shed to turn it back on in this cold.

I was getting this trash speed.

And I am on voyager not 2degrees. It seems to have finished ok on the second try but I will download it again to be sure.

Edit: tried again and it started off ok and was saying 2 mins to go and 55MB/sec, got half way and the speed tanked to 1.5-3 with it going up and down like crazy.

Most distros offer torrents. They're generally a lot faster even when you don't have these issues.

timmmay

20580 posts

Uber Geek

Trusted

Lifetime subscriber

#2245448 25-May-2019 17:04

S3 can automatically generate a torrent for any file, but that's not much use if the torrent isn't published and widely used.