proxy server on ubuntu VPS - to beat traffic shaping

Forums › Desktop computing › proxy server on ubuntu VPS - to beat traffic shaping - not working :(

quadiator

31 posts

Geek

Topic # 49808 20-Nov-2009 15:30

i have squid proxy server setup on a ubuntu machine - i am just learning at the moment so trying out things..

i have configured my firefox to run thru the proxy. its all working well

i went to www.whatismyip.com - came up with proxy server ip - so far so good

then i go to www.speedtest.net - they display my original IP address.? how is that possible? thru the ping test they do right at the start? and they get information off that some how?

i can see that proxy server is working, because when i test my speed thru firefox configured with my proxy the pings are much higher and speed is much lower.

when i run a speed test thru IE which is not proxy configured i am getting far better speeds. so proxy is working fine.

no proxy:

proxy:

LennonNZ

2315 posts

Uber Geek
+1 received by user: 363

Trusted

Reply # 274765 20-Nov-2009 15:55

Proxies forword the ip address its coming from via the X-FORWARDED-FOR in the HTTP request.. If you don't want to leak your real ip address then set up your proxy not to forward it

header_access X-Forwarded-For deny all is your firiend

quadiator

31 posts

Geek

Reply # 274842 20-Nov-2009 21:44

thanks for the quick reply.

one more question that i have around the same context.

situation : using the proxy server to get over traffic shaping my ISP is imposing on couple of sites

is there a way for the ISP to find out which IP am i sending off the requests to. ie the real destination or they can only see the proxy's ip?

Regs

Infrastructure Geek
4042 posts

Uber Geek
+1 received by user: 193

Trusted

Microsoft NZ

Subscriber

Reply # 274844 20-Nov-2009 21:53

is your squid proxy server on a different ISP? if not, i fail to see why it would make any difference

Technical Evangelist
Microsoft NZ
about.me/nzregs
Twitter: @nzregs

wazzageek

Go Hawks!
750 posts

Ultimate Geek
+1 received by user: 23

Trusted

Subscriber

Reply # 275039 21-Nov-2009 21:37

quadiator: thanks for the quick reply.

one more question that i have around the same context.

situation : using the proxy server to get over traffic shaping my ISP is imposing on couple of sites

is there a way for the ISP to find out which IP am i sending off the requests to. ie the real destination or they can only see the proxy's ip?

I bypass my office ISP's transparent proy by VPN'ing over to our cohosted machines and pushing the traffic through the VPN, rather than letting it go through the naked interwebs.

Having said that - the only way is going to be be to encapsulate the traffic through to something beyond control of your ISP. (Ie. talking to another proxy server out there on the internet.

quadiator

31 posts

Geek

Reply # 278239 1-Dec-2009 12:54

ok.. thanks everyone.. maybe i need to explain my situation with more details..

i am a home brodband user, my isp clearly shapes downloads from www.megaupload.com . any other website i download from except from megaupload i am getting 1000kb/s. if i download from the megaupload website i get no more than 150kb/s.

to overcome this problem i thought a proxy server will help.

so i went off and subscribed for a linux based vps with 100gb bandwidth, i am sharing a 100mbps line with other users.

i have a squid proxy setup there. address: tempvps.thruhere.net port: 3128 (you can try it out. no username/pass required at this stage)

my proxy can download from the website at 6mb/s, and upload at about the same rate.

**so this is the setup

***now when i download from any website except megaupload.com via proxy i am getting 800kb/s

****my downloads from megaupload.com via proxy server still gives me no more than 150kb/s

so clearly my ISP is able to findout that i am downloading from meagupload.com even though i am using a proxy.

--how can they findout ?

---how do i overcome that?

wazzageek

Go Hawks!
750 posts

Ultimate Geek
+1 received by user: 23

Trusted

Subscriber

Reply # 278244 1-Dec-2009 13:02

Can you install a webserver onto your vps and test the throughput from there - it could be the transit that your traffic takes from your local machine through to your VPS.

Have you configured squid to NOT forward through the IP address of your local machine? (I.e. thinking here that the throttling could be coming from the web server, rather than the transit provider(s)

Failing all that, can you setup an SSH tunnel through to your proxy server (i.e encrypted traffic from your machine to the proxy server), that may provide an insight into where the slow down is occuring.

quadiator

31 posts

Geek

Reply # 278251 1-Dec-2009 13:16

Can you install a webserver onto your vps and test the throughput from there - it could be the transit that your traffic takes from your local machine through to your VPS.

--have apache installed on vps. can download files from VPS at 1000kb/s

Have you configured squid to NOT forward through the IP address of your local machine? (I.e. thinking here that the throttling could be coming from the web server, rather than the transit provider(s)

--no i havent done that. i dont entirely understand whats said here.

my understanding of a proxy: packet sent from MY ip to VPS ip - VPS ip to Megaupload.com ip - megaupload.com ip to VPS ip - VPS ip to my IP

so you are saying squid is going to send the packets: MY ip to VPS ip - (at vps) MY ip to megaupload.com ip - megaupload.com ip to VPS ip - VPS ip to MY ip

you asking if megaupload is implement shaping on my ip? - in other words my isp advised megaupload on what ips to shape traffic on? (some kind of agreement?)

Failing all that, can you setup an SSH tunnel through to your proxy server (i.e encrypted traffic from your machine to the proxy server), that may provide an insight into where the slow down is occuring.

- have tried this. i am not sure if i have done it right.

i have opened a tunnel on putty D8081 and then redirected all traffic from my download manager to localhost 8081.

used wireshark to monitor - all packets are destined for vps and receiving packets from vps ip too. - speeds are still at 150kb/s