up vote 1 down vote favorite
share [g+] share [fb]

I have ~70ms latency over my VPN connection and need to set up a backup/replication system. SMB is the worst, with throughput ~200KB/s. SCP gives me ~400KB/s. HTTP ~700KB/s. The links are symmetric 50mbit connections.

Is there any kind of file transfer protocol designed for this kind of high latency connection?

Thanks.

link|improve this question
62% accept rate
what does ftp look like? – tony roth Jan 5 at 18:42
1  
Stationwagon full of tapes. – Tom O'Connor Jan 5 at 18:48
Have you looked at WAN accelerators? Not inexpensive but can really help. – Dave M Jan 5 at 20:01
feedback

3 Answers

up vote 4 down vote

If you already have a VPN in-place, then ftp might be a valid choice.

A latency of ~70ms is not what I would call high though. SCP and http should perform far better then what you describe on a 50mb/s 70ms link. You may have some other problem. You might want to use iperf or something else that can test the raw capacity of your connection.

link|improve this answer
2  
+1 for other problem. I regularly reach over 1MiB/s on 200+ms links. RSS should take care of latency, if there are lots of small files to transfer, than every protocol will be slow. tar them before transfer. If tarring doesn't help: you've got different problem. – Hubert Kario Jan 5 at 21:01
+1. 70ms rtd is not that much and transfers over a 50Mb/s link shoud really be faster than what the OP states. Other problem here. – petrus Jan 5 at 21:36
feedback
up vote 2 down vote

I'd use tar

you can either create a tarfile and transfer it, or directly pipe the output throught netcat or similar tools.

The advantage is that the protocol won't do a lot of file-open handshakes.

link|improve this answer
feedback
up vote 1 down vote

I would probably use scp or rsync and the arcfour cipher.

link|improve this answer
If that's too tricky, robocopy can be setup to wait/retry if the connection drops, but robocopy is only clever enough to overwrite the whole of any changed file rather than just the changes. – Robin Gill Jan 5 at 19:00
feedback

Your Answer

 
or
required, but never shown
discard

Not the answer you're looking for? Browse other questions tagged or ask your own question.