I need to transfer a number of files files over a low-quality broadband link to a server. The files are large, and take approximately 30 minutes to transfer per file.
I use scp, but it sometimes hangs -- the transfer doesn't fail with an error, it keeps running, but no further data is transferred.
So, I'm looking for a "failsafe" upload solution, one that will work even if the link fails for a few minutes or is otherwise unreliable.
My idea is:
- split big file in small parts
- upload parts, with timeout and retry if fail
- is there a ready-to-run tool that implements this idea? (no specific need for scp. could be ftp or anything else)
- is there a way to detect when scp hangs? ((that is, it is still running, but does not transfer data)