Possible Duplicate:
Copy large file from one Linux server to another
I need to transfer about ~3tb of data to another server. I am currently using rsync -z but it is going at 250kb/s so it will take forever. How can I speed it up?
-
4Buy a bigger pipe or sneaker net.– GregDOct 3, 2011 at 18:24
-
I am assuiming you have already compressed the data.– jftugaOct 3, 2011 at 18:40
-
I haven't compressed the data yet but wouldn't that take forever?– Matthew HuiOct 3, 2011 at 18:45
-
Would transferring 3tb at 250kb not also take forever? there is no magic solution.– TomTomOct 3, 2011 at 18:56
-
1What kind of link are you transferring over (on both ends)? I agree, sneaker net is probably the best option.– David SchwartzOct 3, 2011 at 19:25
|
Show 3 more comments
2 Answers
Mail a hard drive to the server and have a technician plug it in.
-
1I agree. This is probably the fastest, most cost effective way of getting it done. Oct 3, 2011 at 18:32
-
Yep, this is were the old pigeon beats the inter-tubes. It'll have to be a big heavy-duty pigeon, but still :-) This is also a good opportunity to keep an archive/backup on a bunch of hard disks, kept in a vault. Oct 3, 2011 at 18:37
-
1en.wikipedia.org/wiki/IP_over_Avian_Carriers where you have much larger packet sizes. Oh, and UDP.– cjcOct 3, 2011 at 18:42
-
+1 "Never underestimate the bandwidth of a station wagon full of tapes hurtling down the highway." -Andrew Tanenbaum– Mike1980Oct 3, 2011 at 19:33
You can try to split data into let's say 3000 pieces using split command and transfer it using netcat (nc or netcat command) over UDP. It's usually faster than TCP. Then you can rsync them to make sure it all gets transferred correctly.
-
Academic answer - correct but totally useless. It wont magially make thigns 100 times faster and that is what is needed here. A mere 25% faster upload wont solve the problem.– TomTomOct 3, 2011 at 18:57