29

How is it possible to pipe out wget's downloaded file? If not what alternatives should I use?

46
wget -O - -o /dev/null  http://google.com
  • 11
    The -o /dev/null is only necessary if you truly don't care about errors, since without that errors will be written to stderr (while the file is written to stdout). – Greg Hewgill Jun 15 '09 at 11:03
  • right. or you can check error codes... as long as you pipe output to a file not another command. – pQd Jun 15 '09 at 11:23
  • AFAIK, no need to -o /dev/null because that goes to stderr anyway. – Milan Babuškov Jun 15 '09 at 11:27
  • 10
    You can use wget -qO- $URL to simplify things. – Oli Jul 5 '11 at 12:04
  • wget -qO- $URL works if you're using Wget on Windows – Chris S Jan 27 '12 at 12:29
34

Or use curl, where it's the default behaviour.

curl http://www.google.com/

http://curl.haxx.se/

  • 4
    -s won't hurt to make it quiet, particularly with a small file. – Acumenus Oct 6 '14 at 22:54
6

There are other methods you can use instead of wget and curl:

You can use lynx:

# lynx -source http://www.google.com

w3m:

# w3m -dump_source http://www.google.com

and libwww-perl comes with a handy program called GET (as well has HEAD and POST, which do what you think they do)

# GET http://www.google.com
  • 1
    Offtopic, but I've used lynx in some of my scripts to parse html for me automatically whenever I've needed the content of a page and didn't care about the markup. It's great for that – Matt Simmons Jun 15 '09 at 12:46
  • indeed, both lynx and w3m have a -dump option. I prefer w3m for its table and frame support. – David Pashley Jun 15 '09 at 14:00
0

Just to add another option: I often use lwp-request, from libwww-perl, for this. It outputs to STDOUT by default and is more likely than curl to be installed on the systems I use (your situation my vary).

  • FWIW, Mac OS has curl (not wget) and I believe other BSD's do as well. As do a lot of embedded *nix systems I've used. Not sure if Perl is more common than curl. – Wyatt8740 Feb 2 '16 at 21:18
0

This is how I did it:

URL='http://wordpress.org/extend/plugins/akismet/'
curl -s "$URL" | egrep -o "http://downloads.wordpress.org/plugin/[^']+" | xargs wget -qO-
0

I suggest to use Aria2. It's powerful downloader.

aria2c http://google.com.tw

protected by Sven Jan 28 '16 at 16:27

Thank you for your interest in this question. Because it has attracted low-quality or spam answers that had to be removed, posting an answer now requires 10 reputation on this site (the association bonus does not count).

Would you like to answer one of these unanswered questions instead?

Not the answer you're looking for? Browse other questions tagged or ask your own question.