Spark peering

Forums › Spark New Zealand (including Skinny and BigPipe) › Spark peering

1 | 2 | 3 | 4 | 5 | 6 | 7 | 8

463 posts

Ultimate Geek

#2172198 3-Feb-2019 13:44

104.24.2.14 is in a Cloudflare anycast range, so it will be advertised globally at many geographic locations. If you trace the route from most major cities it's usually only a few ms away.

It is advertised in Sydney as a traceroute from iiNet shows.

Tracing the route to 104.24.2.14

1 gi1-2-950.cor1.syd6.on.ii.net (150.101.199.50) 0 msec 0 msec 0 msec
2 xe-0-2-1.cr1.syd4.on.ii.net (150.101.197.2) 0 msec 4 msec 0 msec
3 ae3.cr2.syd4.on.ii.net (150.101.41.123) 4 msec 4 msec 0 msec
4 13335.syd.equinix.com (45.127.172.154) 4 msec 0 msec 4 msec
5 104.24.2.14 0 msec 0 msec 4 msec

Strangely though, when I tried Optus and Telstra, they both end up over 100ms away so probably HK/Japan too. Maybe Cloudflare have capacity issues in Sydney?

freitasm

BDFL - Memuneh
79309 posts

Uber Geek

Administrator

ID Verified

Trusted

Geekzone

Lifetime subscriber

#2172199 3-Feb-2019 13:46

Talkiet:

about 6 days ago Cloudflare started serving some traffic to Spark customers from HongKong instead of from Aussie. I don't know why - it's up to them or their customers.

I have no say on where traffic is served from - it's between the ISP and Cloudflare and peering arrangements.

Talkiet:

I have had a look at the level of traffic coming into AS4771 from Cloudflare in the last couple of days and unfortunately it's still a rounding error so doesn't justify any investment from an international traffic saving point of view.

I know the largest sites in New Zealand won't be on Cloudflare (Trade Me, Stuff, NZ Herald, TVNZ, Newshub, MSN, Google, Facebook, Twitter) but I would imagine a long tail would still be significant. It is worrying that so much comes from top ten online properties.

hio77

12999 posts

Uber Geek

ID Verified

Trusted

Lizard Networks

#2172202 3-Feb-2019 13:59

Surely MSN no longer ranks...

#include <std_disclaimer>

Any comments made are personal opinion and do not reflect directly on the position my current or past employers may have.

hashbrown

463 posts

Ultimate Geek

#2172203 3-Feb-2019 14:01

freitasm:

I have no say on where traffic is served from - it's between the ISP and Cloudflare and peering arrangements.

Not sure if it's an additional cost over anycast routing, but Cloudflare do offer DNS load balancing, which would allow customers to steer traffic.

https://support.cloudflare.com/hc/en-us/articles/115000540888-Load-Balancing-Geographic-Regions

Talkiet

4793 posts

Uber Geek

Trusted

#2172205 3-Feb-2019 14:04

freitasm:

Talkiet:

about 6 days ago Cloudflare started serving some traffic to Spark customers from HongKong instead of from Aussie. I don't know why - it's up to them or their customers.

I have no say on where traffic is served from - it's between the ISP and Cloudflare and peering arrangements.

Talkiet:

I have had a look at the level of traffic coming into AS4771 from Cloudflare in the last couple of days and unfortunately it's still a rounding error so doesn't justify any investment from an international traffic saving point of view.

I know the largest sites in New Zealand won't be on Cloudflare (Trade Me, Stuff, NZ Herald, TVNZ, Newshub, MSN, Google, Facebook, Twitter) but I would imagine a long tail would still be significant. It is worrying that so much comes from top ten online properties.

I can't give exact traffic figures but for context I can say the traffic Cloudflare currently serve into AS4771 is approx TWENTY TIMES lower than our smallest on-net CDN and over 100 times smaller than our largest.

Yes peering in NZ is technically an option as well, but at the current traffic levels even that isn't a sensible option for us.

Cheers - N

Please note all comments are from my own brain and don't necessarily represent the position or opinions of my employer, previous employers, colleagues, friends or pets.

freitasm

BDFL - Memuneh
79309 posts

Uber Geek

Administrator

ID Verified

Trusted

Geekzone

Lifetime subscriber

#2172207 3-Feb-2019 14:07

@hio77: Surely MSN no longer ranks...

You'd be surprised. It does as default homepage for Internet Explorer and Chrome, as logout for Hotmail, Outlook.com and other services.

@hashbrown:

freitasm:

I have no say on where traffic is served from - it's between the ISP and Cloudflare and peering arrangements.

Not sure if it's an additional cost over anycast routing, but Cloudflare do offer DNS load balancing, which would allow customers to steer traffic.

That is to route traffic to a specific origin server, not to a CDN node.

There's a perfectly good AKL node. Spark doesn't peer. That's the story.

hio77

12999 posts

Uber Geek

ID Verified

Trusted

Lizard Networks

#2172208 3-Feb-2019 14:09

freitasm:
@hio77: Surely MSN no longer ranks...

You'd be surprised. It does as default homepage for Internet Explorer and Chrome, as logout for Hotmail, Outlook.com and other services.

Chrome doesn't default unless the user imports their ie settings.

#include <std_disclaimer>

Any comments made are personal opinion and do not reflect directly on the position my current or past employers may have.

Sharesies

Trade NZ and US shares and funds with Sharesies (affiliate link).

freitasm

BDFL - Memuneh
79309 posts

Uber Geek

Administrator

ID Verified

Trusted

Geekzone

Lifetime subscriber

#2172209 3-Feb-2019 14:10

@Talkiet:

I can't give exact traffic figures but for context I can say the traffic Cloudflare currently serve into AS4771 is approx TWENTY TIMES lower than our smallest on-net CDN and over 100 times smaller than our largest.

Next you are going to say Geekzone is the largest NZ-origin server site being served from Cloudflare...

Talkiet

4793 posts

Uber Geek

Trusted

#2172210 3-Feb-2019 14:13

freitasm:

@Talkiet:

I can't give exact traffic figures but for context I can say the traffic Cloudflare currently serve into AS4771 is approx TWENTY TIMES lower than our smallest on-net CDN and over 100 times smaller than our largest.

Next you are going to say Geekzone is the largest NZ-origin server site being served from Cloudflare...

Nope, we don't have any visibility of individual site stats - I can only see aggregate traffic from the various CF nodes into AS4771.

However, you and I together could probably figure out what percentage of AS4771 Cloudflare traffic is GZ :-)

Cheers - N

Please note all comments are from my own brain and don't necessarily represent the position or opinions of my employer, previous employers, colleagues, friends or pets.

michaelmurfy

meow
13265 posts

Uber Geek

Moderator

ID Verified

Trusted

Lifetime subscriber

#2172433 3-Feb-2019 21:03

I do have a ticket open with Cloudflare with why traffic is going to either HK or Tokyo instead of Australia. They do have some datacentres in Australia re-routed however do state that traffic should be still hitting Sydney. I think this is more or less a routing issue (again, guessing).

I'm not clear on the details but really hoping that by doing this, I can at-least help the user experience for those on Spark who use websites hosted behind Cloudflare like Geekzone. It is amazing, by using a VPN the performance is night and day to websites like Geekzone which has servers also based here in NZ.

Michael Murphy | https://murfy.nz
Referral Links: Quic Broadband (use R122101E7CV7Q for free setup)

Are you happy with what you get from Geekzone? Please consider supporting us by subscribing.
Opinions are my own and not the views of my employer.

Talkiet

4793 posts

Uber Geek

Trusted

#2172435 3-Feb-2019 21:07

Using the developer tools in Chrome I get typical page load times of 1.8-2.2 seconds for GZ front page (But yes I have an ad blocker)... (7-8 Ctrl-F5's in a row)

It doesn't feel any slower for me over the last 5-6 days while it's apparently being served from further than Sydney...

Cheers - N

Please note all comments are from my own brain and don't necessarily represent the position or opinions of my employer, previous employers, colleagues, friends or pets.

freitasm

BDFL - Memuneh
79309 posts

Uber Geek

Administrator

ID Verified

Trusted

Geekzone

Lifetime subscriber

#2172437 3-Feb-2019 21:15

@Talkiet:

Using the developer tools in Chrome I get typical page load times of 1.8-2.2 seconds for GZ front page (But yes I have an ad blocker)... (7-8 Ctrl-F5's in a row)

I gave you a courtesy subscription for the next two weeks. See the difference those scripts make (even if using an ad blocker)...

yitz

2082 posts

Uber Geek

#2172440 3-Feb-2019 21:35

I think 2 seconds is about standard for this site when being served from an offshore Cloudflare node. Not on Spark right now but am being served from Cloudflare in LA.

As described above a far cry from the consistent fraction of a second load times when served out of Sydney/Auckland. Haven't had traffic served out of Auckland since about September last year on this connection.

freitasm

BDFL - Memuneh
79309 posts

Uber Geek

Administrator

ID Verified

Trusted

Geekzone

Lifetime subscriber

#2172441 3-Feb-2019 21:40

To @yitz and others: visit https://testip.geekzone.co.nz/ and look for HTTP_CF_RAY. Mine says AKL and has been consistently like this (on 2degrees):

yitz

2082 posts

Uber Geek

#2172450 3-Feb-2019 21:45

I get HTTP_CF_RAY 4a3397f7997520cc-LAX

The ISP supposedly peers at AKL-IX too, I don't think they have a bilateral peering with Cloudflare in Auckland so peering at a multilateral peering exchange isn't enough for Cloudflare to stay local at least.

1 | 2 | 3 | 4 | 5 | 6 | 7 | 8