Take the 2-minute tour ×
Server Fault is a question and answer site for professional system and network administrators. It's 100% free, no registration required.

I am currently using robocopy to an extremely slow destination. The compare between source and destination files can take a while to run through.

Since the destination will never change (apart from the robocopy changes), is there any program that will work similarly to robocopy, but have a local list of what files (attributes and timestamps) the destination has, to compare with?

I know there are expensive solutions which may do this, but I'm looking for something free if possible. Hopefully this makes sense.

share|improve this question

2 Answers 2

No, Robocopy is not capable of doing this. It will skip file data for files that already exist at the destination, but it needs to compare file attributes (timestamps, ACLs, filesize,) in real time to do it. There is no way to feed Robocopy a local "catalog" of the file attributes at the remote destination.

Don't forget to use the /MT switch (multithreading) in Robocopy; it will speed up small operations like this when you're dealing with tons of small files. While one thread is blocked waiting to see what the file attributes of the remote file are so it can compare it to the local copy, another thread can move on to the next file, and so on in parallel. Default is 8 threads with /MT but you can adjust it.

You do not specify or give any other information about whether these are Servers or not, but since you asked this on SF, I'm going to just assume you're talking about Windows Server. And in that case, you can look into DFS-R (Distributed File System) which is pretty efficient at incremental transfer of files, bandwidth throttling and scheduling, in-flight data compression, etc. And it also satisfies your requirement of "free if possible," because it's a standard out of the box installable role for Win Server.

share|improve this answer

Try bvckup, it solves your problem in a slightly different way.

share|improve this answer

Your Answer

 
discard

By posting your answer, you agree to the privacy policy and terms of service.

Not the answer you're looking for? Browse other questions tagged or ask your own question.