There are a number of factors that can slow you down not least of which is that your ISP controls a very small section in a very complex series of tubes between you and the server you are requesting data from. Given that you can achieve near line speed in a random speed test but are having trouble with this specific service I would be inclined to suggest routing issues beyond the immediate control of the ISP are a likely factor.