![]() ![]() ![]() ![]() |
|
Opinions are my own and not the views of my employer.
CYaBro: Is it a cloudflare issue or quic/vetta?
They haven't been announcing their BNG prefixes since the outage so it'll be an asymmetric route (peering? or even transit) back via Auckland most likely - you can check https://lg.ix.nz/
michaelmurfy:
@AndrewTG got any further details? Logged a fault?
If anyone is going to post saying they’re experiencing issues please provide how you came to this conclusion and details as just saying you’re having issues doesn’t actually help anyone.
I was playing an online game when it occurred. On multiple different games, it would cause me to disconnect from the server. I am not sure how often these micro outages occur, being as short as they are they are only really noticeable while playing games. When I drop out, I quickly try other webpages to confirm it was not just the game. I would also drop out of the discord call I am in.
The packet loss shown on the picture below is very normal for me, even before the micro outages. And as I ping every 30 seconds, they wouldn't really show up any different.
The packet loss shown here is significantly improved from the hair loss inducing packet loss of the old network and isn't really much of an issue for me, but these micro outages are.
I have a 900/400 plan, I am using DHCP, my router is an x86 box running OpenWrt, I am connected via 2.5Gb ethernet
We host a minecraft server at home, for my sons and their friends to play on, and my eldest son told me this morning that his friends kept getting kicked off yesterday.
Opinions are my own and not the views of my employer.
@AndrewTG That's interesting. I've been really trying to detect it on my connections (I've got 2 on different ONT's) but not getting the micro drops, just some minor packet loss:
On my Fortigate I adjusted some of the SD-WAN monitors to 1sec testing intervals to see if I can pick it up. I wouldn't say I am getting micro dropouts like you are (also been in Teams calls all morning with no problems) but some minor loss is there:
Based on what I know about last weeks incident I think they're being very cautious right now while they investigate what happened. I'd personally rather this, than an full outage like we saw on Thursday. Hopefully it is back to normal soon.
I did ping somebody at Vetta and they're checking it out but their priority is investigation into last Thursday I think right now.
Michael Murphy | https://murfy.nz
Referral Links: Quic Broadband (use R122101E7CV7Q for free setup)
Are you happy with what you get from Geekzone? Please consider supporting us by subscribing.
Opinions are my own and not the views of my employer.
I actually managed to pick it up (thanks @AndrewTG) and even saw it happen on one of my own connections. It is super hard to detect but totally see what you mean @squareeyes123. It's just bizarre mainly because I monitor my connection from different points and Smokeping or my external monitors don't pick this up at all as it is really quick hence why I was really focused on fishing for more details here. The more details everyone provides the easier for all of us to verify and let them know.
I was in a Teams call before when mine dropped for just a few seconds causing all audio to drop and the call to go into a hold state. On my router I saw it happen on the connection I was using:
However that's at 1sec resolution - but the timestamp, and the fact it didn't affect AndrewTG's connection on the same BNG narrowed things down but I know that AndrewTG would have also got knocked off for a few seconds here. I flicked it through to Quic and they've narrowed down the problem here but they're currently in a change freeze pending their investigation of last Thursday and are aware of a few problems since then but have added it to the list.
I'm just the messenger here though! Again, I don't work for them or anything like that but just really trying to gather as much information as possible to help everyone (including Quic) out.
Michael Murphy | https://murfy.nz
Referral Links: Quic Broadband (use R122101E7CV7Q for free setup)
Are you happy with what you get from Geekzone? Please consider supporting us by subscribing.
Opinions are my own and not the views of my employer.
Here's a good view. Something keeps compressing my image but you get the idea. (12 hrs yesterday):
@squareeyes123 yours as previously stated is worse than everyone else’s and you’re on the same BNG as Andrew and I also.
I’m able to see the problem now but your outages don’t line up at all to anyone else’s. It’s still however a residential service and by the sounds of things you’re using it for a little more than residential use. Perhaps going to a service with a SLA may be the go here?
Im running a radio station on my connection also and don’t see listener drops. Yes there’s a problem but I think yours is much worse and may qualify as a contender to log a fault with.
Michael Murphy | https://murfy.nz
Referral Links: Quic Broadband (use R122101E7CV7Q for free setup)
Are you happy with what you get from Geekzone? Please consider supporting us by subscribing.
Opinions are my own and not the views of my employer.
It's also present on CHCH bng2 but it's nowhere near as bad.
Context this is my VPS in Miami with smoke ping target set for my rDNS which goes straight to home.
215ms is expected but not the less than 5% packet loss every few hours which is again far less than the users above.
I will do additional testing from inside home when I get back tonight.
Edit actually do need to remove the IP woops
Ramblings from a mysterious lady who's into tech. Warning I may often create zingers.
I use quic. They're a great ISP for techies. Use my referral I get money off my bill! You can get the setup fee waived too via this code when you order! R177510EBNVXP
@MaxineN, not sure if you meant to include the smokeping host IP address in the screenshot?
CPU: AMD 5900x | RAM: GSKILL Trident Z Neo RGB F4-3600C16D-32GTZNC-32-GB | MB: Asus X570-E | GFX: EVGA FTW3 Ultra RTX 3080Ti| Monitor: LG 27GL850-B 2560x1440
Quic: https://account.quic.nz/refer/473833 R473833EQKIBX
mentalinc:
@MaxineN, not sure if you meant to include the smokeping host IP address in the screenshot?
Edit
Removed it anyway
Ramblings from a mysterious lady who's into tech. Warning I may often create zingers.
I use quic. They're a great ISP for techies. Use my referral I get money off my bill! You can get the setup fee waived too via this code when you order! R177510EBNVXP
Possibly seeing the same thing to a minor extent in Hamilton, had 3 dropouts during teams calls today, a couple 10-15s and a longer one of around a minute. Don't have monitoring stats to catch it though so can't prove it's the same thing, but odd seeing I've not had that before.
eonsim: Possibly seeing the same thing to a minor extent in Hamilton, had 3 dropouts during teams calls today, a couple 10-15s and a longer one of around a minute. Don't have monitoring stats to catch it though so can't prove it's the same thing, but odd seeing I've not had that before.
If you don't have any monitoring doing a long running MTR to 1.1.1.1 will likely show you the problem. You should see problems occur from Hop 3 onwards during one of these drops. If it is occurring before this then it is another, unrelated problem.
Michael Murphy | https://murfy.nz
Referral Links: Quic Broadband (use R122101E7CV7Q for free setup)
Are you happy with what you get from Geekzone? Please consider supporting us by subscribing.
Opinions are my own and not the views of my employer.
I gave myself 10000 pings to 1.1.1.1, 8.8.8.8 and my own VPS in Miami, from my home connection.
My results are quite... inconclusive.
The VPS is on the right and there is certainly something up on the upstream side specifically being outside of Quic's control (I see AS55850 is Mercury's network into the states before it hands off to Twelve99, and then it gets messy from there)
I'm not seeing it as dramatic on smokepings at either side(between VPS and home) but then it's not shooting a ICMP ping every second so I'm either not catching it or they're being dropped.
(The above image is from my Raspberry PI at home)
There's certainly packets being dropped but I can't feel it and my own results are pretty much inconclusive and you shouldn't read into this much.
I wish I had my graphs from when I was still on One NZ UFB.
More testing required from me but I honestly can't find a fault except with my VPS.
Some useful testing methodology and equipment if anyone is curious.
WinServer 2019.
MTU 1500 on LAN and the WAN side.
Broadcom NIC on WinServer. Intel i226 on the Opnsense Firewall with DHCP with NO VLAN tagging.
Ramblings from a mysterious lady who's into tech. Warning I may often create zingers.
I use quic. They're a great ISP for techies. Use my referral I get money off my bill! You can get the setup fee waived too via this code when you order! R177510EBNVXP
|
![]() ![]() ![]() ![]() |