GNU Wget (or just Wget, formerly Geturl) is a computer program that retrieves content from web servers, and is part of the GNU Project. Its name is derived from World Wide Web and get. It supports downloading via HTTP, HTTPS, and FTP protocols.

learn more… | top users | synonyms

0
votes
0answers
8 views

How to download Symantec Managed PKI ssl certificate using wget or any other unix command [closed]

I usually download the Symantec SSL certificate from Symantec Managed PKI site to my local machine and upload to the server. I would like to directly download SSL certificate from Symantec Managed PKI ...
-2
votes
0answers
13 views

Cannot connect to SOME websites from home but fine from neighbor [migrated]

From home I cannot connect to the following sites (either partially or completely): abritel.fr, homeaway.fr, airbnb.com. From the SAME computers, if I try from 3G, from work or from my neighbor's, it ...
0
votes
1answer
2k views

Using curl with cookies

I hope someone can help me out on this one. I have been trying this for a while now, with all sorts of variations and cannot seem to get this to work. I am trying to script a way to log in to https://...
0
votes
1answer
17 views

URL encoding issue with cron and wget

I have a simple bash script: #!/bin/bash wget -q 'http://requestb.in/1fq0r3s1?foo=a%2Bb' -O /dev/null If I run this from the commandline and then inspect at http://requestb.in/1fq0r3s1?inspect I ...
-1
votes
1answer
27 views

vshpere wget: bad address 'releases.ubuntu.com'

on a raw vsphere esxi 6 without any vm installed i have to setup vm's and ... remotely so i decided to open ssh to esxi and download an Ubuntu iso using wget this way: wget http://releases.ubuntu....
0
votes
0answers
25 views

Download file from server using a command line

I have 2 different servers, I put my mp3 files in server1, and I am testing to download them from server2 using the wget tool: wget "http://www.example.com/Path-to-mp3-file" I have 2 results: 1) ...
11
votes
5answers
16k views

Wget a script and run it

I want to download a script from: http://dl.dropbox.com/u/11210438/flockonus-stack.sh and execute it. My guess is, to use wget renaming it, chmod it, and execute. What are the commands for doing ...
1
vote
0answers
16 views

Can wget detect remote duplicate files (with different names) and download only one?

I'm retrieving a dynamic website contents recursively. Unfortunately, files are available from different dynamic URLs. For instance, maybe file http://foo.bar/bla.php?q=xyz and http://foo.bar/bla....
0
votes
1answer
69 views

How do I ensure that a CoreOS cloud-config service is able to download files?

I am defining a one-shot service in my CoreOS cloud-config, but it is failing due to not being able to download files from Google Cloud Storage (via wget): Apr 13 11:09:56 staging-node-ys9y.c....
5
votes
2answers
887 views

What to do if wget's progress:mega doen't cut it anymore?

I have script for downloading large files in a queue. Now I would really appreciate it, if I had a decent log. Specifying the -o or -a option is apparently specially made for that, however as of the ...
3
votes
3answers
5k views

using wget through .pac config based proxy server

I want to use wget through a proxy which uses .pac config. When I googled a bit, I found that .pac is a javascript file and wget cannot parse it based on the following url http://www.linuxquestions....
0
votes
1answer
1k views

multiple post requests using wget and same base-url

wget has nice option that lets you allow downloading multiple files from same location (I mean combination of --base and --input-file) Advantage of this, is that if possible wget tries to reuse ...
15
votes
3answers
7k views

Wget: Is there a way to pass username and password from a file?

Is there a way to pass the username and password from a file instead of the command line via --user and --password? Background: I want to run wget via cron and don't want the username/password show ...
3
votes
1answer
2k views

How can I get a static download link for a Microsoft MSDN Subscriber Download?

I need to be able to download MSDN ISO files directly from power shell, and therefore I am wondering how can I do this? I can view the downloads site at https://msdn.microsoft.com/subscriptions/...
3
votes
1answer
637 views

Cron Daemon Wget blocked

I've got nginx on Debian 7 without cpanel. I am seting-up my Crontab like this: */45 * * * * wget "http://example.com/cron-url.php" >/dev/null 2>&1 The above cron is being blocked with ...
4
votes
4answers
20k views

curl succeeds on an https request, wget does not

When I run curl from the command line curl "https://example.com" It succeeds immediately, returning the result of the request. When I run the same wget command wget https://example.com It ...
0
votes
0answers
22 views

wget truncating files in centos 7

We have used this on Centos 5 and 6 without issues for years: if /usr/bin/wget --timeout=120 --user=$User --password=$Pass -S -O ${Tmp_path}/${Tmp_file}.asc ${Rules_url}/sigs-${Version}.tar.gz.asc 2&...
0
votes
2answers
83 views

IPTables: apt-get and wget not working

When resetting IPTables, the apt-get and wget command functions correctly and also downloads what I want. But once I activate this firewall, it isn't functional. Pings still work. I want to allow all ...
17
votes
6answers
26k views

How do I pipe a downloaded file to standard output in bash?

How is it possible to pipe out wget's downloaded file? If not what alternatives should I use?
0
votes
1answer
878 views

wget giving Segmentation fault

I recently did apt-get update followed by apt-get upgrade on my Debian VPS server. Suddenly (at least) wget stopped working with error Segmentation fault. It's not even trying to do something. So ...
13
votes
4answers
49k views

Is there a built-in command-line tool under Windows like wget/curl?

I come from a Linux/Unix background and I have been wondering if Windows has a binary that can download files from the console. I would like to automate a certain process and one of my requirements ...
1
vote
1answer
69 views

how can I download web pages from the command line in windows

Well, I'm trying to do some automation using batch file to speed up my daily routine at work, and I need to solve these little questions: I want to install wget command, but using only the pure ...
104
votes
5answers
135k views

how to download the ssl certificate from a website?

I want to download the ssl certificate from, say https://www.google.com, using wget or any other commands. Any unix command line? wget or openssl?
1
vote
2answers
4k views

wget ftp connection failing after PASV command

In attempting to transfer all files from one web server ("source") to another ("destination"), the wget command is connecting via FTP, but cannnot proceed beyond the PASV command. I'm using an SSH ...
-3
votes
2answers
52 views

Server not recognizing that wget is installed on OS X Yosemite [closed]

I'm trying to install some software (called Prohits, used for mass spectrometry data management) on a localhost server I set up. One of the requirements for the install is that I have wget installed. ...
3
votes
2answers
4k views

How to exclude certain directories while using wget?

I'd like to download a directory from a FTP, which contains some source codes. Initially, I did this: wget -r ftp://path/to/src Unfortunately, the directory itself is a result of a SVN checkout, so ...
3
votes
2answers
4k views

HTTP downloads stop after some time, resuming is not possible

When I try to download a file via HTTP, the downloads sometimes stop after around 30 MB. The download rates goes down to 0 B/s and no data keeps coming. When I stop the download and resume again, the ...
1
vote
0answers
49 views

Server socket sitting in FIN_WAIT_1 whilst network doesn't see its traffic

We've been trying to get a grip on a really weird problem where we can wget a page from Apache 2.2.19 on solaris 10 and some permutations of requests reliably take various fixed lengths of time to ...
0
votes
0answers
45 views

Unable to access internet through amazon ec2 instance

I have instance running on Amazon EC2.Basically i am accessing my Amazon EC2 instance through VPN using Vagrant openconnect https://github.com/ericmann/openconnect-vm . I am able to ssh into instance ...
1
vote
0answers
240 views

why is a wget to http://graph.facebook.com resolving to my server's IP?

This makes absolutely no sense and I spent 3 hours trying to figure this out. Suddenly all my scripts connecting to Facebook stopped working, so I tried to do this: root@s01 [~]# wget http://graph....
1
vote
3answers
9k views

why i cannot download jdk from oracle web site directly without AuthParam?

that is download with the following command, why it fails to download that file? wget http://download.oracle.com/otn-pub/java/jdk/6u35-b10/jdk-6u35-linux-i586.bin the following command works, but ...
1
vote
2answers
1k views

Allow connection from localhost to the HTTPS/Port 443 Protocol

We've recently set up a new development server and have been experiencing problems when trying to connect to an API via an instance of SoapClient. I think I've narrowed down the issue to being the ...
0
votes
2answers
130 views

What could block the output of a command?

Sometimes I'll attempt a (2>&1) redirection and some/all of the resulting output appears to be silenced. e.g. wget -O- http://localhost/test.txt 2>&1 I would expect to see a merge of ...
0
votes
1answer
18 views

wget blocking subdirectiories

I would like to recursively download a page, but block link like this containing "strony": http://domain.com/rozrywka/strony/2/ my command is wget -r -nd --delete-after -e robots=off -X strony ...
0
votes
1answer
137 views

Server to Server file transfer through wget

I have a dedicated server in Germany with 120GB data, since I have bought a new dedicated server in U.S, I would like to transfer all the files to new server through FTP connection, to achieve this I'...
0
votes
1answer
515 views

Download an SSL certificate from a remote website through a proxy

I want a script checking my server's certificate. There are very good answers around here how to get this with openssl s_client or gnutls-cli, which works fine.... but NOT if you are behind a proxy! ...
1
vote
1answer
131 views

Which Ubuntu package has the CA for debian.neo4j.org (godaddy)?

The neo4j site shows that you should get their certificate using wget -q -O - http://debian.neo4j.org/neotechnology.gpg.key This, of course, could allow their certificate to be hacked. So, I ...
-1
votes
1answer
177 views

wget does not work with IPv6 [closed]

My Debian server has both IPV4 and IPV6 addresses. I am using file_get_contents in my php script to get video titles from youtube: if($content=file_get_contents("http://www.youtube.com/...
0
votes
1answer
126 views

APT-GET behind a proxy with Digest Authentication

I'd like to use apt-get (and other ubuntu tools) to download software and keep it updated. Unfortunately, my company has set a squid proxy to accept digest authentication only. I've seen somewhere (...
2
votes
1answer
270 views

wget - Only save if return code is 200, delete otherwise

I have a script that checks my public ip address every few minutes. The problem is the ISP sometimes gives me cached pages (I know, I've used all the related args in wget, the isp is formed by a bunch ...
0
votes
1answer
404 views

wget and pipe to tar in the background

I am trying to download a large file which is .tar.gz and (> 2GB) in size. The bash script also does lots of other things, so I want to kick off the download and then continue processing other ...
2
votes
0answers
663 views

Wrong filename encoding/decoding when downloading recursively with wget

I'm downloading files from a remote directory recursively using wget and whoever created the folders and files, used special characters such as è or Ó, when I download a single specificating the full ...
44
votes
8answers
42k views

Making `wget` not save the page

I'm using the wget program, but I want it not to save the html file I'm downloading. I want it to be discarded after it is received. How do I do that?
5
votes
7answers
57k views

WGET can't resolve host

I've got 2 machines on the same sub-net running Debian 5.0. They use the same DNS (/etc/resolv.conf), they route to the same gateway (#route) and they have the same iptables settings (#iptables -L). ...
0
votes
1answer
1k views

wget: how to download a file, whose url params changes dynamically, once only

I got a problem with wget, I need to download an entire site with images and other files linked in main pages, I'm using these options: wget --load-cookies /tmp/cookie.txt -r -l 1 -k -p -nc 'https://...
0
votes
2answers
104 views

nginx can't execute many requests

I have a question about nginx tune. I have an application which I want execute 200 times every second. I created bash file and used wget with bqO switch for execute. But it has a problem. When the ...
0
votes
2answers
2k views

wget shows 404 not found while the page is live

This looks simple but I don't know how to fix. Open the following URL in your browser: https://ecomm.sella.it/gestpay/gestpayws/WSCryptDecrypt.asmx?WSDL This seems working and this will download ...
0
votes
2answers
3k views

Wget, self signed cert and --no-check-certificate not working

I recently installed a self signed SSL cert on one of our nginx webservers. If I attempt to wget a file with --no-check-certificate I receive the errors below. You can reach the site with a browser, ...
2
votes
0answers
520 views

Recursively get files over FTP with explicit SSL

Is there a way to recursively get a whole directory from another server using FTP with explicit SSL on Linux? I have tried a number of wget combinations including with and without the passive flag ...
-2
votes
2answers
111 views

Why is wget failing on this Url? [closed]

if I do a wget on BBC RSS it works fine: wget http://feeds.bbci.co.uk/news/world/rss.xml But if I do that with times, I get a 403 forbidden error: wget http://www.thetimes.co.uk/tto/news/rss ...