Tell me more ×
Server Fault is a question and answer site for professional system and network administrators. It's 100% free, no registration required.
up vote -2 down vote favorite

Possible Duplicate:
Copy large file from one Linux server to another

I need to transfer about ~3tb of data to another server. I am currently using rsync -z but it is going at 250kb/s so it will take forever. How can I speed it up?

share|improve this question
4  
Buy a bigger pipe or sneaker net. – GregD Oct 3 '11 at 18:24
I am assuiming you have already compressed the data. – jftuga Oct 3 '11 at 18:40
I haven't compressed the data yet but wouldn't that take forever? – Matthew Hui Oct 3 '11 at 18:45
Would transferring 3tb at 250kb not also take forever? there is no magic solution. – TomTom Oct 3 '11 at 18:56
1  
What kind of link are you transferring over (on both ends)? I agree, sneaker net is probably the best option. – David Schwartz Oct 3 '11 at 19:25
show 3 more comments

marked as duplicate by GregD, MikeyB, EEAA, Ward, mailq Oct 3 '11 at 20:51

This question has been asked before and already has an answer. If those answers do not fully address your question, please ask a new question.

2 Answers

up vote 8 down vote

Mail a hard drive to the server and have a technician plug it in.

share|improve this answer
1  
I agree. This is probably the fastest, most cost effective way of getting it done. – Justin Pearce Oct 3 '11 at 18:32
Yep, this is were the old pigeon beats the inter-tubes. It'll have to be a big heavy-duty pigeon, but still :-) This is also a good opportunity to keep an archive/backup on a bunch of hard disks, kept in a vault. – DutchUncle Oct 3 '11 at 18:37
en.wikipedia.org/wiki/IP_over_Avian_Carriers where you have much larger packet sizes. Oh, and UDP. – cjc Oct 3 '11 at 18:42
+1 "Never underestimate the bandwidth of a station wagon full of tapes hurtling down the highway." -Andrew Tanenbaum – Mike1980 Oct 3 '11 at 19:33
up vote -1 down vote

You can try to split data into let's say 3000 pieces using split command and transfer it using netcat (nc or netcat command) over UDP. It's usually faster than TCP. Then you can rsync them to make sure it all gets transferred correctly.

share|improve this answer
Academic answer - correct but totally useless. It wont magially make thigns 100 times faster and that is what is needed here. A mere 25% faster upload wont solve the problem. – TomTom Oct 3 '11 at 18:57

Not the answer you're looking for? Browse other questions tagged or ask your own question.