The tag has no wiki summary.

learn more… | top users | synonyms

0
votes
2answers
420 views

Scientific data storage: many small files, one volume or several?

I have about 8 TB worth of 'sample' data with the following characteristics: each sample: 5-15 GB in one folder containing ~20k files and ~10k subfolders (2000 top-level, 5 sub-level containing a ...
0
votes
3answers
3k views

Too many files open issue (in CentOS)

Recently I ran into this issue in one of our production machines. The actual issue from PHP looked like this: fopen(dberror_20110308.txt): failed to open stream: Too many open files I am running ...
2
votes
5answers
237 views

Thousands of files to backup…overhead killing us

We have a system that generates literally 5k - 10k XML files each day. It's a long story but that system will not change for a while. Anyway, the system dumps these XML files (3k-20k each) into ONE ...
1
vote
2answers
80 views

Removing files on a limit access backup server

I have an account on a backup server but it's full, so I need to clear it. The problem is that It's only accessible via FTP, SFTP and Rsync (no shell) Deleting lots of small files (as in, multiple ...