We have an online production server (source, half-history) which contains recent N days (or M months) audio files, we want to backup/archive/synchronize those audio files to backup server(s) (destination(s), full-history). When the destination disk is about to be full, we will power off the backup server, and install a new hard drive disk, but we do not want backup/archive/synchronize the files which are already backuped again.
We want to use open source tool, say rsync, to do this job. But once if the new hard drive disk is installed, rsync will re-synchronize from the source.
- Is there a way to let rsync remember synchronized files and do not synchronize them again ?
- or, is there another open source solution can meet the requirement ?
--Edit--
I forgot to mentioned that
- The source server is running Windows Server 2003 system with Cygwin installed, and the backup servers can be intalled linux system, but better use windows client system, because the users are not technicians.
- The total file size and file amount are large, it tooks me 80+ minutes to get the du information of files and another 80+ minutes to get file list of files which were produced in a single month 2012-07.
find -type d -name 201207* -exec du -s {} \; > 2012-07-dir-stats.txt
: 382 directories, 267 GB (279715008 KB).find -type f -name 201207* > 2012-07-file-list.txt
: 1093962 files (file size of list file itself is 80+ MB. - The source server contains recent N days audio files means: there're operations like deletion of old files and creation of new files occurs every day. (this is one of the reason make above file listing so slow, because lots of fragments exist).