Take the 2-minute tour ×
Server Fault is a question and answer site for system and network administrators. It's 100% free, no registration required.

Update: This is just for one way transfer. No need to sync.

I am currently using Robocopy to transfer a huge file which is zipped and send to a remote network share.

Is there a faster tool? Lately, file sizes have been increasing and the transfer process is taking more time. Any help would be great.

share

locked by HopelessN00b Dec 5 at 6:10

This question exists because it has historical significance, but it is not considered a good, on-topic question for this site, so please do not use it as evidence that you can ask similar questions here. This question and its answers are frozen and cannot be changed. More info: help center.

6 Answers 6

Check out RichCopy.

From the web site:

RichCopy is a free utility that comes to us from Ken Tamaru of Microsoft. The tool was first developed in 2001 and has been updated regularly to keep pace with evolving needs. Trust me when I tell you, this is the answer to all your file copying needs. What you'll find most striking the first time you take RichCopy out for a spin is that it's a multithreaded copying tool. That means that rather than copying one file at a time in serial order, RichCopy can open multiple threads simultaneously, allowing many files to be copied in parallel and cutting the total time required to complete the operation several times over. You can also pause and resume file copy operations, so if you lose network connectivity at any point, you can just pick up where you left off.

share
    
Downvoted? I think somebody doesn't understand the intent of downvotes. –  aphoria May 4 '09 at 0:26

This may sound like a lot, but upgrade both ends to Vista/Server 2008. I did some informal tests over a quiet (10 computer) 100MB network. According to the rate shown in the copy dialog and the network monitor in the Resource Monitor, I was using about 97% of the 100MB line.

Other than that, use a more powerful compression method that zip? Maybe bzip2 or lzma ? You'd need to test them based on the type of data you're compressing.

share

If you can set up FTP on the destination server, you might very well see some benefit in using that instead of poky ol' SMB. And it's probably easier than upgrading both boxes to Server 2k8...

share

Regardless of which transfer protocol you use, you can increase throughput by increasing the TCP Window size of the client side system as high as you can set it. This defines the maximum packet size the client can receive. I've seen as much as 2x improvement over a WAN compared with default settings on Windows 2000.

Wikipedia has a TCP Tuning article that explains some of this. Windows lets you set TCP window size globally or per interface.

share

If the files are based on the same data the rsync is an option. It will only send the changed data.

Zip files do have a tendency to change all the binary data in the file even for small changes however so it may not be too useful.

share
    
this is just one file and zipped. –  Gulzar May 1 '09 at 22:29

Kind of depends what you mean by remote network share. Remote like across the country? Or remote like on a small GB lan?

If you can't change to sending differences like Ryaner suggested, the limiting factors are disk speed of two computers, line speed of everything between the two computers, the speeds of switches between the two computers, MTU of all switches and NICs. If it is on a small GB LAN, maybe the easiest thing would be to make the MTUs as big as possible.

share
    
it is to a remote data center. right now, i am only checking if any faster tool is available optimized for file transfer . –  Gulzar May 1 '09 at 22:49

Not the answer you're looking for? Browse other questions tagged or ask your own question.