up vote -2 down vote favorite
share [g+] share [fb]

Possible Duplicate:
Copy large file from one Linux server to another

I need to transfer about ~3tb of data to another server. I am currently using rsync -z but it is going at 250kb/s so it will take forever. How can I speed it up?

link|improve this question
100% accept rate
4  
Buy a bigger pipe or sneaker net. – GregD Oct 3 '11 at 18:24
I am assuiming you have already compressed the data. – jftuga Oct 3 '11 at 18:40
I haven't compressed the data yet but wouldn't that take forever? – glumbo Oct 3 '11 at 18:45
Would transferring 3tb at 250kb not also take forever? there is no magic solution. – TomTom Oct 3 '11 at 18:56
1  
What kind of link are you transferring over (on both ends)? I agree, sneaker net is probably the best option. – David Schwartz Oct 3 '11 at 19:25
show 3 more comments
feedback

closed as exact duplicate by GregD, MikeyB, ErikA, Ward, mailq Oct 3 '11 at 20:51

This question covers exactly the same ground as earlier questions on this topic; its answers may be merged with another identical question. See the FAQ for guidance on how to improve it.

2 Answers

up vote 8 down vote

Mail a hard drive to the server and have a technician plug it in.

link|improve this answer
1  
I agree. This is probably the fastest, most cost effective way of getting it done. – Justin Pearce Oct 3 '11 at 18:32
Yep, this is were the old pigeon beats the inter-tubes. It'll have to be a big heavy-duty pigeon, but still :-) This is also a good opportunity to keep an archive/backup on a bunch of hard disks, kept in a vault. – UnisoftDesign Oct 3 '11 at 18:37
en.wikipedia.org/wiki/IP_over_Avian_Carriers where you have much larger packet sizes. Oh, and UDP. – cjc Oct 3 '11 at 18:42
+1 "Never underestimate the bandwidth of a station wagon full of tapes hurtling down the highway." -Andrew Tanenbaum – Mike1980 Oct 3 '11 at 19:33
feedback
up vote -1 down vote

You can try to split data into let's say 3000 pieces using split command and transfer it using netcat (nc or netcat command) over UDP. It's usually faster than TCP. Then you can rsync them to make sure it all gets transferred correctly.

link|improve this answer
Academic answer - correct but totally useless. It wont magially make thigns 100 times faster and that is what is needed here. A mere 25% faster upload wont solve the problem. – TomTom Oct 3 '11 at 18:57
feedback

Not the answer you're looking for? Browse other questions tagged or ask your own question.