My server has a big dataset stored on disk. I am worried by the possibility of the data being silently corrupted over the years without anybody noticing. My idea was to generate "recovery data" for these file so that I can recover from small corruptions like .rar files can (winrar can add recovery data or recovery volumes). Is there any tool available to generate recovery data without modifying the files themselves?
For CDs and DVDs, people produce recovery sets with high redundancy and burn the set of blocks to multiple discs, expecting it to be unlikely that a given block would become corrupt on every single CD. With 100% redundancy, the original file can be recreated from the par files alone but the par files will take twice the disk space as the original data (plus overhead).
In your case, I'd be sure that the par files are stored separately from the dataset so that an event can't ruin both sets of data at once. Also, generating the archive files in the first place is a CPU intensive function... at 100% it took an otherwise idle 2GHz server 18.8 seconds to create par files for a single 3.7MB file