34

How is it possible to pipe out wget's downloaded file? If not what alternatives should I use?

51
wget -O - -o /dev/null  http://google.com
5
  • 13
    The -o /dev/null is only necessary if you truly don't care about errors, since without that errors will be written to stderr (while the file is written to stdout). Jun 15 '09 at 11:03
  • right. or you can check error codes... as long as you pipe output to a file not another command.
    – pQd
    Jun 15 '09 at 11:23
  • AFAIK, no need to -o /dev/null because that goes to stderr anyway. Jun 15 '09 at 11:27
  • 12
    You can use wget -qO- $URL to simplify things.
    – Oli
    Jul 5 '11 at 12:04
  • wget -qO- $URL works if you're using Wget on Windows
    – Chris S
    Jan 27 '12 at 12:29
36

Or use curl, where it's the default behaviour.

curl http://www.google.com/

http://curl.haxx.se/

1
  • 4
    -s won't hurt to make it quiet, particularly with a small file.
    – Asclepius
    Oct 6 '14 at 22:54
6

There are other methods you can use instead of wget and curl:

You can use lynx:

# lynx -source http://www.google.com

w3m:

# w3m -dump_source http://www.google.com

and libwww-perl comes with a handy program called GET (as well has HEAD and POST, which do what you think they do)

# GET http://www.google.com
2
  • 1
    Offtopic, but I've used lynx in some of my scripts to parse html for me automatically whenever I've needed the content of a page and didn't care about the markup. It's great for that Jun 15 '09 at 12:46
  • indeed, both lynx and w3m have a -dump option. I prefer w3m for its table and frame support. Jun 15 '09 at 14:00
1

This is how I did it:

URL='http://wordpress.org/extend/plugins/akismet/'
curl -s "$URL" | egrep -o "http://downloads.wordpress.org/plugin/[^']+" | xargs wget -qO-
0

Just to add another option: I often use lwp-request, from libwww-perl, for this. It outputs to STDOUT by default and is more likely than curl to be installed on the systems I use (your situation my vary).

1
  • 1
    FWIW, Mac OS has curl (not wget) and I believe other BSD's do as well. As do a lot of embedded *nix systems I've used. Not sure if Perl is more common than curl.
    – Wyatt Ward
    Feb 2 '16 at 21:18
0

I suggest to use Aria2. It's powerful downloader.

aria2c http://google.com.tw
1

Not the answer you're looking for? Browse other questions tagged or ask your own question.