I'm looking for something faster than WinSCP

Forums › LAN (ethernet/Wifi/routers/Bluetooth) › I'm looking for something faster than WinSCP

kiwifidget

"Cookie"
3666 posts

Uber Geek
+1 received by user: 1989

Lifetime subscriber

#246667 15-Feb-2019 13:31

Long long story, much much shorter...

I am using WinSCP to copy files from a Drobo NAS to a Windows Home Server 2011.

(The why, is the long long story)

These 2 devices are both connected to the same Gigabit switch, and both have Gigabit ethernet connections.

Before the long long story, when I was able to map directly to the Drobo from Windows, I would see transfer speeds vary from 50MB/s upwards.

But with WinSCP I am getting only 10-12MB/s, and it's going to take a considerable number of days to copy 15TB at that rate.

Is this a limitation of WinSCP or are there faster options??

Drobo support have recommended WinSCP, to use SCP connection type, and disable "optimise connection buffer size".

Thank you.

Delete cookies?! Are you insane?!

1 | 2

3826 posts

Uber Geek
+1 received by user: 1374

Lifetime subscriber

#2180938 15-Feb-2019 13:47

Have you tried Putty scp binary.

ObidiahSlope

260 posts

Ultimate Geek
+1 received by user: 66

#2180943 15-Feb-2019 13:50

Try wbadmin. A command line utility which can export to a network share. I have no idea about speed. Try it and see.

Details at;

https://docs.microsoft.com/en-us/windows-server/administration/windows-commands/wbadmin-start-backup

Admin account privileges required in a cmd window.

Obsequious hypocrite

kiwifidget

"Cookie"
3666 posts

Uber Geek
+1 received by user: 1989

Lifetime subscriber

#2180944 15-Feb-2019 13:51

@spyware No I have not, but I am willing to give it a try.

My area of expertise outside of the Microsoft environment is practically non-existent.

I'm pretty sure I could count on one hand the number of times I have had to use utilities like this.

Thank you.

Delete cookies?! Are you insane?!

Spyware

3826 posts

Uber Geek
+1 received by user: 1374

Lifetime subscriber

#2180945 15-Feb-2019 13:54

pscp.exe -r root@192.168.1.100:/volume1/ .

kiwifidget

"Cookie"
3666 posts

Uber Geek
+1 received by user: 1989

Lifetime subscriber

#2180950 15-Feb-2019 14:08

@spyware Thank you.

When I type the pscp command (altered for my situation) all that happens is that I get a list of pscp options.

Delete cookies?! Are you insane?!

allio

895 posts

Ultimate Geek
+1 received by user: 529

#2180975 15-Feb-2019 14:59

In my experience SCP is an order of magnitude slower than other file transfer methods. Because it is built on SSH, the focus is on security rather than speed. I don't think it's really intended to be used for large files or ongoing NAS use - more for securely moving small files on or off a server that isn't set up to serve files.

Apparently there is a project that can massively speed up SCP performance by patching certain bottlenecks in the underlying SSH platform, but I doubt you can install that on your drobo.

Mighty Ape

Shop now at Mighty Ape (affiliate link).

timmmay

20923 posts

Uber Geek
+1 received by user: 5395

Trusted

Lifetime subscriber

#2180978 15-Feb-2019 15:02

Resilio Sync, it's pretty fast over a local network, I expect it uses a bunch of threads. Or multi-threaded FTP.

Spyware

3826 posts

Uber Geek
+1 received by user: 1374

Lifetime subscriber

#2180980 15-Feb-2019 15:03

kiwifidget:

@spyware Thank you.

When I type the pscp command (altered for my situation) all that happens is that I get a list of pscp options.

https://www.tecmint.com/scp-commands-examples/

kiwifidget

"Cookie"
3666 posts

Uber Geek
+1 received by user: 1989

Lifetime subscriber

#2181020 15-Feb-2019 16:51

Thanks for the help.

Just to clarify, this is for a one-time transfer of files from the Drobo NAS to a Windows PC.

Once that is done, the NAS will be rebuilt/reset and the files can be copied back using normal Windows copy and paste.

Then I will look into options for automated daily backups of the NAS to the Windows PC, which will be another thread for another day.

For now still trying to get pscp going to see if its faster.

Delete cookies?! Are you insane?!

kiwifidget

"Cookie"
3666 posts

Uber Geek
+1 received by user: 1989

Lifetime subscriber

#2181030 15-Feb-2019 17:09

@timmmay I had a look at Resilio Sync , and it seems you need it installed on both devices.

I am unable to install any apps on the Drobo for the time being.

Thank you anyway, it may be useful for once I have got everything up and working again... in August :)

Delete cookies?! Are you insane?!

timmmay

20923 posts

Uber Geek
+1 received by user: 5395

Trusted

Lifetime subscriber

#2181034 15-Feb-2019 17:15

It's very helpful software. I run it on phones, tablet, PC, and family computers around the world. Multithreaded FTP tends to be very fast and well-supported.

Quic Broadband

Move to New Zealand's best fibre broadband service (affiliate link). Free setup code: R587125ERQ6VE. Note that to use Quic Broadband you must be comfortable with configuring your own router.

fe31nz

1303 posts

Uber Geek
+1 received by user: 430

#2181143 15-Feb-2019 23:28

The basic problem you are fighting is that SCP is an encrypted protocol. I know nothing about Drobo NAS boxes, but in general, NAS boxes do not have hardware encryption capability for their networking, so they have to do it in software, using their CPU(s). Typically NAS boxes do not have big, fast CPUs, so that will limit the rate at which they are able to encrypt data. And even if they do have a multi-core CPU, often the encryption code is limited to using only one core. I would expect a NAS box to do a bit better than what you are getting, but since you were only getting pretty slow speeds using an unencrypted Windows connection (presumably SMB protocol), you should only expect to get a third or less of the unencrypted speed when using a good encryption such as used by SCP.

So how old is the Drobo NAS? What CPU does it have?

One thing you can try is to use a less CPU intensive cypher. I have not used WinSCP, so I do not know if it will alow you to change the cyphers that it requests, or even get it to request that no cypher be used. But even if you can, the NAS may say that it can not do the cypher you are requesting - they cypher has to be mutually negotiated between the two ends, and the connection will not start if the ends do not have a mutually compatible cypher option available.

muppet

2682 posts

Uber Geek
+1 received by user: 1734

Trusted

#2181158 16-Feb-2019 06:31

rsync

mentalinc

3403 posts

Uber Geek
+1 received by user: 1035

Trusted

#2181159 16-Feb-2019 06:59

Try to use FTP, remove all types of encryption assuming you are on a "secure" network i.e. at home...

So you not setup a normal windows file share (seems this many be the long story part)?

CPU: AMD 5900x | RAM: GSKILL Trident Z Neo RGB F4-3600C16D-32GTZNC-32-GB | MB: Asus X570-E | GFX: EVGA FTW3 Ultra RTX 3080Ti| Monitor: LG 27GL850-B 2560x1440

Quic: https://account.quic.nz/refer/473833 R473833EQKIBX

cyril7

9075 posts

Uber Geek
+1 received by user: 2499

ID Verified

Trusted

Subscriber

#2181165 16-Feb-2019 08:11

Not dealt with Drobo before, but from what I see its a mac centric NAS, but in addition to AFP it would appear to support SMB/CIFS, and probably NFS, both should be better performers.

Cyril

1 | 2