2degrees UFB 1Gbps connection but only getting 450 + lag spike.

Forums › 2degrees (including Slingshot, Orcon, Flip, Stuff Fibre, MyRepublic, 2talk and Vocus) › 2degrees UFB 1Gbps connection but only getting 450 + lag spike.

1 | 2 | 3 | 4 | 5 | 6

30853 posts

Uber Geek

Retired Mod

Trusted

Biddle Corp

Lifetime subscriber

#2195477 11-Mar-2019 08:04

plas:

I don't have any useful info on me (@ work now), but this started happening late Saturday evening. In Discord we could tell who was on 2Degrees due to voice breaking up and we would all get kicked from POE at the same time.

There are two very distinct issues in this thread.

One is what appears to be congestion on a route between 2D and the game servers. This issue may or may not be anything to do with 2D, and a fix isn't necessarily a straight forward one as it very much depends on why the routing change has occurred.

The second is performance issues on the OPs connection, which are hard to diagnose due to their setup. There is a reason most RSPs won't really provide support for anything but hardware they supply - because complex setups using 3rd party hardware can lead to performance issues particularly on Gigabit connections.

D1NZ

194 posts

Master Geek

#2195498 11-Mar-2019 08:32

sbiddle:

D1NZ:

edgerouter 4 more capable? I am running Snort IDS/IPS also pfBlockerNG with tons of list.

Had test the Suricata but it's not playing very nicely with PPPoE, and keep killing itself, end of the day I switched back to Snort and been rock solid.

USG just had IDS/IPS added not long ago and it's still in beta, also pfSense managing my 3kV UPS too.

To me pfSense has everything I need and more but sadly to say edgerouter not there yet.

Your consistent results with different sites across multiple times with no increase in latency look very like hardware limiting at your end. Routing 1Gbps *is* difficult, and there are plenty of devices out there that will not cope.

Since you've only added this all recently have you tried going back to a basic config? If these features kill the hardware offloading there is no way the router will ever get close to routing 1Gbps.

What happened to your original Fritz!box? I'd suggest going back to this for testing purposes.

The real world reality is that Gigabit throughput issues are very rarely ever Chorus/LFC or RSP related.

Hi sbiddle

I had 1Gbps as early as they just made available on 2Degrees, and same mini pc running pfSense can handle it without even breaking a sweat.

This build will actually 10Gbps no problem too, just with a simple NIC change.

With those said, this doesn't not explain it was doing 1Gbps for many years til few day ago? Nothing in pfSense has been changed not even setting.

And I checked pfSense update, last update was few months ago back in Dec.

I can confirm that in end of Jan becuase my fibre at cabinet was cut, and I did a speedtest confirm with the tech fixing it for me everything was back in normal.

NickMack

962 posts

Ultimate Geek

Trusted

Lifetime subscriber

#2195719 11-Mar-2019 11:26

Hi All,

Sorry about the delay, busy weekend :-) Customer Care should be the first port of call for all issues in the first instance for residential faults/issues - 0800 022 022. They have the ability to escalate to one of my engineering teams should this be required (And they did with respect to the latency issue which I will cover off below)

I've have a read of the thread- This as others have mentioned, is two potential issues - 1. Latency to some gaming servers, 2. Performance issues on a residential connection where behaviour may have changed.

1. Latency to some gaming servers

The cause of the latency with selected games appears to be resolved. Based on reports from customer care (and later by the GZ thread) there were 2 games affected:

“Path of Exile”

World of Warcraft

The cause of the issue was due to our peering with Equinix flapping in Sydney, this was causing a few blocks of routes to flap – mainly “SoftLayer” prefixes impacting the game “Path of Exile”. This was causing issues with spikes in latency as the path was constantly being learned and then abruptly switched to another stable path with another upstream provider as it was unlearned. The reason this was flapping was because Equinix had increased the amount of prefixes that they are advertising to us – likely due to a new peer much like when Hurricane Electric recently joined NZ and impacted domestic tables. This increase exceeded their previous recommended amount by approx. 5000. As best practice we have limits in place to tear down the peerings in these cases to prevent bigger issues like major upstream route leaks. We resolved the issue by incrementally increasing the allowed limit on this peering. These changes were made late evening last night to resolve this issue.

Closing this one out -

We are following up today with Equinix for their updated recommendation of prefix limits to receive. Generally we are notified of an increase before hand to prevent issues like this.

We are also making some tuning changes for BGP peerings flaps on our monitoring system in case we don't receive notifications about BGP peerings as an early warning mechanism.

2. Performance issues on a residential connection where behaviour may have changed

The fibre provider was been engaged to look at the service they are providing - All profiles/QOS/plans are correct for this connection - Keep working with Customer Care to investigate, from the Core side everything looks as it should.

Nick.

https://nick.mackechnie.co.nz | NZ ISP latency monitoring - https://smokeping.thenet.gen.nz

ripdog

548 posts

Ultimate Geek
Inactive user

#2195746 11-Mar-2019 11:58

I wasn't involved in this one, but damn Nick - I love you so much. You're by far and away the biggest selling point for 2degrees over other ISPs. Keep it up.

NickMack

962 posts

Ultimate Geek

Trusted

Lifetime subscriber

#2195763 11-Mar-2019 12:04

ripdog:

I wasn't involved in this one, but damn Nick - I love you so much. You're by far and away the biggest selling point for 2degrees over other ISPs. Keep it up.

:-) There's a great team here focused on making sure our customers have a great experience.

Nick.

https://nick.mackechnie.co.nz | NZ ISP latency monitoring - https://smokeping.thenet.gen.nz

hio77

12999 posts

Uber Geek

ID Verified

Trusted

Lizard Networks

#2195767 11-Mar-2019 12:08

ripdog:

I wasn't involved in this one, but damn Nick - I love you so much. You're by far and away the biggest selling point for 2degrees over other ISPs. Keep it up.

He's almost at Mark P status at this stage ;)

#include <std_disclaimer>

Any comments made are personal opinion and do not reflect directly on the position my current or past employers may have.

freitasm

BDFL - Memuneh
79263 posts

Uber Geek

Administrator

ID Verified

Trusted

Geekzone

Lifetime subscriber

#2195769 11-Mar-2019 12:12

You mean RalphFromSnap?

GoodSync

GoodSync. Easily back up and sync your files with GoodSync. Simple and secure file backup and synchronisation software will ensure that your files are never lost (affiliate link).