Take the 2-minute tour ×
Server Fault is a question and answer site for professional system and network administrators. It's 100% free, no registration required.

I know from the manual pages of bzip2 that it writes it's data in blocks, of sizes from 100-900kb.

We have ran into a problem with a 150GB bzip2 file, that it gives an "Unexpected EOF" error when unpacking it.

I realized that at least some subcomponents of the bzip2 tool set, such as bzip2recover, has a limit for the maximum number of blocks that it can process (50000 for bzip2recover).

I could increase this by modifying the source code and recompile, but I tried to find a correpsonding limit in the bzip2 tool itself, which I suspect could be the reason for our "EOF" error on the file.

I haven't been able to find the limit yet though, but maybe someone can point it out for me?

share|improve this question
    
Are you sure the file is not corrupted? –  Khaled Jan 25 '12 at 11:58
    
The error message did not say anything about integrity error, which I've seen that others get sometimes, so I don't know, but I'm trying to run bzip2recover now, in order to get individual files for each block and then check them each for integrity. Only it takes a lot of time (I first ran into the "100 000 files per dir" limit of our main file system, and needed to restart on another disk with a more capable file system). –  Samuel Lampa Jan 25 '12 at 12:09
add comment

Your Answer

 
discard

By posting your answer, you agree to the privacy policy and terms of service.

Browse other questions tagged or ask your own question.