1

I have downloaded 80.000+ image files stored on a FTP-site using wget(1) and most of the files where downloaded without problems but when I did a small check (using file(1)) I just realized that a few of the files were empty!?!

I just used this command:

wget -r -nH --user YYY --password ZZZ ftp://X.X.X.X

I would have expected the ftp transfer either to retry or/and eventually fail. Is this a bug in wget(1) og in the ftp-protocol?

I can see others have the same problem!

1 Answer 1

0

Well I'm not sure why the files are empty but you can try wget -c 'ftp://image-link' with all the links it should re-download/resume corrupted files only.

5
  • That would (probably) work but I am scared about the fact that I cannot rely on wget/ftp to either get the file or fail! Commented Nov 28, 2013 at 16:04
  • 1
    Are you sure that it's wget issue maybe the files are corrupted on the FTP server?
    – Izzy
    Commented Nov 28, 2013 at 16:11
  • The site owner tells me that he has the files - but yes that is a possibility! :-| Commented Nov 28, 2013 at 16:12
  • Do you store a log of the wget actions with wget --append-output=logfile?
    – HBruijn
    Commented Nov 28, 2013 at 16:22
  • Well no - the log would be so big that I would not know what to look for - but a good suggestion anyway. Commented Nov 28, 2013 at 17:48

You must log in to answer this question.

Not the answer you're looking for? Browse other questions tagged .