Take the 2-minute tour ×
Server Fault is a question and answer site for professional system and network administrators. It's 100% free, no registration required.

I'm having an issue with what I believe is my host. I believe after a static number of I/O calls I/O is denied entirely and the computer freezes. The point in time when the switch happens from working fine to not working at all seems to be very short. I guessed on the problem and found a product that seems to do exactly this (EverGrid / Librato):

It has been modified to intercept all library calls to allocate memory and I/O from applications as they are running. The applications do not have to be modified for this shim to work and neither do the operating systems or hypervisors. In fact, none of the software is aware that there is a traffic cop on the system actually controlling what resources different bits of software get.

What other products do this? Is there a name of it? Is there a way to track windows kernel calls (like strace) on Linux without paying for the license to use Microsoft Detours?

I'm trying to move 650k unused images from directory A to directory B, it is a simple loop that tests if the picture exists -- if it does it moves it to directory B, if not it skips to the next picture. Very simple, very I/O bound.

share|improve this question
    
Having 650k entries in an NTFS directory and trying to do anything with them will probably cause quite a few problems - serious system slow downs and freezing up would be fairly typical. –  Helvick Feb 9 '10 at 0:36
    
only if you have to work with a listing, which I'm not doing. –  Evan Carroll Feb 9 '10 at 16:12
    
Fair enough - what sort of virtual platform is this sitting on? –  Helvick Feb 9 '10 at 17:53

1 Answer 1

You problem most likely lies in the 650k files in a single directory. A reasonable limit is somewhere very south of 32k. (The technical limit is 4.3 billion, but as with most cases "if you have to ask, you're probably doing it wrong" - thedailywtf.com)

share|improve this answer

Your Answer

 
discard

By posting your answer, you agree to the privacy policy and terms of service.

Not the answer you're looking for? Browse other questions tagged or ask your own question.