This is regarding the incremental hard-link method of backups, making a daily directory containing a copy of hard links to the original files, and rsync deleting the hardlinks and placing new files for anything changed since the last backup.
I have to contend with a really slow remote rsync NetGear ReadyNAS Duo with a tiny brain and which can only handle about 2 megabit/sec SSH copy rates, while I have 50+ megabit bandwidth available. I don't want to have the program to be backed up, to be shut down for hours while backup data trickles to the slow remote NAS.
Is there a way to make a fast temporary local copy of the specific files to be rsynched, to minimize application/database downtime?
Apparently from what I can determine, the best way to minimize application downtime would be something like this:
- Stop the program/database to be backed up
- Run rsync against remote location, but only list files it would copy
- Use cp to copy those specific files/dirs to fast temporary local storage
- Restart the program/database to be backed up
- Rsync normally from the temp dir to the slow remote storage
- Delete the temporary local file copies
Is this the fastest way to cache the files to be rsynched remotely, or is there some other better method?
Is there a more automatic method to do this, that doesn't require all these separate scripted steps?