Ways to upload 40GB to G's servers anyone?

Forums › New Zealand Broadband › Ways to upload 40GB to G's servers anyone?

jjnz1

1371 posts

Uber Geek
+1 received by user: 195

Lifetime subscriber

#92185 28-Oct-2011 11:29

Hi guys,

I am trying to upload about 40GB of 'stuff' to Googles apps servers but it is going painfully slow...about 120KB/s per application (yes not Kb).

Google docs max upload I have seen is 120KB, and Goog Picasa is also 120KB at the same time.

So it would appear maybe that each of my connections to the big G are not exceeding 120KB/s? Anyone know any reason for this? (using Snap).

I know I can stream a full HD (6000Kb/s) clip to others over my connection, so its definitely not maxing out my connection.

Should I complain to my ISP, or is this expected from Google?

bjorn

192 posts

Master Geek
+1 received by user: 1

#538653 28-Oct-2011 12:41

ADSL2+ has a max line rate of 24.0 Mbit/s down and 1.3 Mbit/s up

So the most you'll ever get is 162.5 KB/sec up

Since it's rare to sync that high I'd say 120KB/sec is predy normal/good.

If you want anything better you need a diffrent tech like VDSL2

Zeon

3926 posts

Uber Geek
+1 received by user: 759

Trusted

#538658 28-Oct-2011 12:45

Sounds like possibly a Google limitation? is it a paid for service?

Speedtest 2019-10-14

jjnz1

1371 posts

Uber Geek
+1 received by user: 195

Lifetime subscriber

#538663 28-Oct-2011 12:51

bjorn: ADSL2+ has a max line rate of 24.0 Mbit/s down and 1.3 Mbit/s up

So the most you'll ever get is 162.5 KB/sec up

Since it's rare to sync that high I'd say 120KB/sec is predy normal/good.

If you want anything better you need a diffrent tech like VDSL2

Sorry, I can stream a 6000Kb/s movie clip from my connection to others easily... My max upload is 10.2Mb up (44Mb down).

Currently I can get 120KB per connection, so if I make 4 connections for example, I get 480KB/s up.

The problem is google doesn't make applications that break down files into multiple parts, so they only upload 1 piece at a time.

If I could do 20 pieces @ 120KB simultaneously I would be happy.

jjnz1

1371 posts

Uber Geek
+1 received by user: 195

Lifetime subscriber

#538670 28-Oct-2011 12:56

Zeon: Sounds like possibly a Google limitation? is it a paid for service?

Yes, Google Apps for Business.

I think I found the problem, and it's related to another thread here on GZ.

It has something to to do with Reach communication supplying Telstra and Snap etc, which makes the connection to Googles server over 280ms. It might also possibly limit each connection?

My other ADSL connection through VF can max out connecting to Google's servers, and the ping is only 70ms. Go figure!

There is a big difference between 70ms and 280ms IMO.

jjnz1

1371 posts

Uber Geek
+1 received by user: 195

Lifetime subscriber

#538680 28-Oct-2011 13:04

Yep, this is crazy... As of right now...

My VF ADSL2+ connection hits an upload speed of 1050Kbps,

and My Snap VDSL2+ connection hits an upload of 350Kbps......

Going to make a phone call now...

Ragnor

8279 posts

Uber Geek
+1 received by user: 585

Trusted

#538692 28-Oct-2011 13:15

That other thread about Telstraclear/Reach throughput problems never did get a resolution.

Dyson

Shop now for Dyson appliances (affiliate link).

Regs

4066 posts

Uber Geek
+1 received by user: 206

Trusted

Snowflake

#538711 28-Oct-2011 13:36

where to start....

* increased latency decreases throughput
* congested pipes decreases throughput
* each router could have an impact, especially busy ones
* throttling on servers descreses throughput

i'd probably be looking to open a ticket with google first, to see if they are throttling things, then open a ticket with your ISP

Sales Engineer
Snowflake
www.snowflake.com

about.me/nzregs
Twitter: @nzregs

jjnz1

1371 posts

Uber Geek
+1 received by user: 195

Lifetime subscriber

#538712 28-Oct-2011 13:37

Ragnor: That other thread about Telstraclear/Reach throughput problems never did get a resolution.

Just rang Snap, and its a known issue with Google stuff only apparently. He did say it has only been going on for less than a week. Maybe its a separate issue than the Reach one?

Hopefully they get some fix next week or so, but by then my 40GB would have already been uploaded... :(

At least when it gets fixed my ongoing daily backups to the Goog will be fast...

Regs

4066 posts

Uber Geek
+1 received by user: 206

Trusted

Snowflake

#538720 28-Oct-2011 13:46

i tried uploading some test pics to picasa, but i couldnt tell what speed they were going at.... the web and application interfaces gave progress bars, but no speed reading

Sales Engineer
Snowflake
www.snowflake.com

about.me/nzregs
Twitter: @nzregs

jjnz1

1371 posts

Uber Geek
+1 received by user: 195

Lifetime subscriber

#538724 28-Oct-2011 13:54

Regs: i tried uploading some test pics to picasa, but i couldnt tell what speed they were going at.... the web and application interfaces gave progress bars, but no speed reading

Same here, you'd need something like a Mikrotik router that does packet inspection. It gives you all kinds of data about each connection. Then you can use something called Ntop web server to visualize it.

ntop shows the current network usage. It displays a list of hosts that are currently using the network and reports information concerning the IP (Internet Protocol) and Fibre Channel (FC) traffic generated by each host. The traffic is sorted according to host and protocol. Protocols (user configurable) include:
TCP/UDP/ICMP
(R)ARP
IPX
DLC
IPsec
AppleTalk
Netbios
TCP/UDP
FTP
HTTP
DNS
Telnet
SMTP/POP/IMAP
SNMP
NFS
X11

Fibre Channel
Control Traffic - SW2,GS3,ELS
SCSI

ntop's author strongly believes in open source software and encourages everyone to modify, improve and extend ntop in the interest of the whole Internet community according to the enclosed licence (see COPYING).

Problems, bugs, questions, desirable enhancements, source code contributions, etc., should be sent to the mailing list.

For information on ntop and information privacy, see this page.

jnawk

176 posts

Master Geek
+1 received by user: 11

#538728 28-Oct-2011 13:58

Ragnor: That other thread about Telstraclear/Reach throughput problems never did get a resolution.

Yeah, it's ongoing. All I've been told each time I ask is more less "we're still working on it".

Edit: Assuming you are talking about my thread :-)