0
votes
2answers
244 views

How to write robust automation scripts for large scale data management?

I have been needing to automate the moving of quite large amounts of data (possibly around 1TB/day+ in average. 60TB so far, and counting) to a separate, remote storage system. I have so far been ...
3
votes
3answers
367 views

Recursively archive small files in document tree on linux?

Given a base directory (like /home/user) is there a command that could be run which would create an archive back up all text files (i.e. files less than 100kb) in that directory and it's children? I ...
0
votes
2answers
4k views

Compress files to daily/weekly/monthly archives with Windows scheduled tasks

For EDI files which need to be archived, I would like to use a compression uitility (like 7Zip) which collects and compresses files based on their file date. For example, a weekly archive ...