The issue is normal web TCP and game UDP traffic gets nailed. Cnn website is a good test, a lot of elements and crap to load, so ~5s or so to connect to it from web browser, another 5s or so for content to begin to show, and then 15s+ while it sits there loading up its adverts etc. One bonus is I don't need adblock now, doubleclick.net stuff rarely loads (pings 29ms for that btw).
Time of day does not seem to affect it much, its just as broken off peak as it is during peak times.