A program of mine is crunching numbers and depending on results creates a directory which stores all the data. Last night it failed. Mkdir no longer worked.
After checking things out I saw that my data directory has close to 36,000 sub directories underneath.
Deleting some of them helped fight the cause.
With that I ask you: is there a magic number of subdirectories that may exist underneath a parent directory? Does it have to do with the amount of data stored? (I don't think so, but still would like a confirmation)
In the above scenario, can I possibly reduce number of directories, maybe gzip some .. Will that solve the problem?
Generally under what circumstance will mkdir fail?