GNU Wget (or just Wget, formerly Geturl) is a computer program that retrieves content from web servers, and is part of the GNU Project. Its name is derived from World Wide Web and get. It supports downloading via HTTP, HTTPS, and FTP protocols.

learn more… | top users | synonyms

2
votes
1answer
2k views

using wget through .pac config based proxy server

I want to use wget through a proxy which uses .pac config. When I googled a bit, I found that .pac is a javascript file and wget cannot parse it based on the following url ...
0
votes
1answer
22 views

Cron getting timeout when attempting to access url (wget).

I'm sure this is simple and I've been digging but no answer is quite as specific as I need it to be. The goal is easy, have Cron hit a url on my server every 5 minutes. All of that is set up and ...
1
vote
1answer
45 views

Wget and recursive downloads

A directory listings enabled folder has 2 zip files. I am trying to download only one of them (the latest). Problem is the zip file name is a random string. The command I have so far is wget -r -nH ...
2
votes
3answers
76 views

wget and port forwarding

I have a weird problem. I can run this command just fine from various servers: wget --debug '--http-user=USER123' '--http-passwd=PASSWORD' http://GW-BOX:9091/weijhkdsvn/v9_odbc//CRONTAB.2014020 ...
2
votes
2answers
733 views

Reboot if tomcat7 service is not responding

I am running a web app on a Tomcat server. There is a hard-to-detect problem within the server code that causes it to crash once or twice everyday. I will dig in to correct it when I have time. But ...
-1
votes
1answer
32 views

wget ftp connection failing after PASV command

In attempting to transfer all files from one web server ("source") to another ("destination"), the wget command is connecting via FTP, but cannnot proceed beyond the PASV command. I'm using an SSH ...
1
vote
1answer
41 views

Ghost running on docker container does not respond to http requests from other container

I am setting up a ghost blog instance inside a docker container. I bound the ghost server to host 0.0.0.0 and exposed the port on which it's listening (port 2368). If I run wget to the ghost ...
5
votes
3answers
17k views

Why wget doesn't verify SSL certificates?

I have a problem with my Fedora 8 installation. It looks that wget doesn't know how to verify SSL certificates any more. It's strange because I have another Fedora 8 box which I believe has the same ...
0
votes
1answer
34 views

Protect public directories from download via wget and curl

My users upload their profile images and I save them in a public folder. The file names are not predictable (they are based on md5 hash of user id with salt). When someone views the user's profile, ...
50
votes
3answers
47k views

how to download the ssl certificate from a website?

I want to download the ssl certificate from, say https://www.google.com, using wget or any other commands. Any unix command line? wget or openssl?
0
votes
1answer
284 views

Wget on busybox v1.9.1

I have busybox 1.9.1 runing in huawei router. There is few commands, one of them wget and I want to use it, but there is some strange syntax. When I type wget www.google.com like I do normaly on my ...
3
votes
6answers
5k views

How to download with wget without following links with parameters

I'm trying to download two sites for inclusion on a CD: http://boinc.berkeley.edu/trac/wiki http://www.boinc-wiki.info The problem I'm having is that these are both wikis. So when downloading with ...
0
votes
0answers
18 views

Use tmux for managing multiple downloaders as a supervisorctl service?

I have many data-servers I need to download data from via http as soon as it is available. For each server I start a bash "while true"-loop and within that a wget to poll the server for new data. To ...
1
vote
1answer
76 views

Allow connection from localhost to the HTTPS/Port 443 Protocol

We've recently set up a new development server and have been experiencing problems when trying to connect to an API via an instance of SoapClient. I think I've narrowed down the issue to being the ...
0
votes
1answer
41 views

Command line tools to monitor POST/GET requests of a loaded website

When I load a website with Firefox and open up the Network Profiler, I can see all the POST and GET requests the site is making. I would like this functionality from the command line. Does any one ...
31
votes
8answers
25k views

Making `wget` not save the page

I'm using the wget program, but I want it not to save the html file I'm downloading. I want it to be discarded after it is received. How do I do that?
1
vote
2answers
265 views

curl succeeds on an https request, wget does not

When I run curl from the command line curl "https://example.com" It succeeds immediately, returning the result of the request. When I run the same wget command wget https://example.com ...
1
vote
1answer
55 views

Why does wget from ftp-sites sometimes create a few empty files when it downloads the rest of the files without problems?

I have downloaded 80.000+ image files stored on a FTP-site using wget(1) and most of the files where downloaded without problems but when I did a small check (using file(1)) I just realized that a few ...
0
votes
3answers
1k views

download only new files from ftp using WGET/cUrl

i have Windows 2008 Server on which i store DB backups on daily basis. I want to be able to download new files only using wget, curl or windows built-in FTP doesn't matter. Can you help me with ...
-1
votes
2answers
2k views

Installing make with wget

How can I install make with wget on CentOS? I tried: cd /tmp wget ftp.gnu.org/pub/gnu/make/make-3.81.tar.gz tar xfz make-3.81.tar.gz cd make-3.81 PATH=/usr/local/bin:/usr/bin:/bin ./configure ...
0
votes
2answers
107 views

“Issued certificate not yet valid.” with wget?

I am getting the following error when using wget to fetch a file: Issued certificate not yet valid. To connect to www.atlassian.com insecurely, use ‘--no-check-certificate’. Testing with openssl ...
0
votes
1answer
52 views

Unable to get cron to append output from wget

I have a cronjob setup and running, but the logfile keeps getting overwritten every time it runs. I would like for the wget output to be appended each time the cron runs. Why is this and how do I fix ...
0
votes
2answers
142 views

Not able to wget to ftp server

I am trying to wget a ftp server from a remote machine. The command is not getting past 'Logging in as anonymous'. This is what i am getting. wget ...
0
votes
6answers
624 views

is there a problem in disabling curl and wget?

Is it recommended to disable curl and wget to disallow anyone from accessing my websites using those commands? Or is it needed for some search engines to access my websites? What are your ...
1
vote
3answers
13k views

How to install wget on this?

I did download RubyStack 2.0.3 for VMWare (Ubuntu 9.10) but I cannot download anything on it! It appears that all basic utilities are missing/screwed: bitnami@linux:/var/tmp$ wget -bash: wget: ...
4
votes
4answers
4k views

Wget a script and run it

I want to download a script from: http://dl.dropbox.com/u/11210438/flockonus-stack.sh and execute it. My guess is, to use wget renaming it, chmod it, and execute. What are the commands for doing ...
8
votes
2answers
555 views

Transfer a 30GB tar file from one remote server to another - restrained by disk space

I have a 38GB "Moodle" tar file that I need to transfer from the old server (Shared hosting), which we can call "Server A" to the new server (Dedicated virtual), or "Server B". I'm with Mediatemple if ...
2
votes
7answers
3k views

Wget, Curl, Yum Fail but Ping works - CentOS 5

We currently have three webservers. Servers one and two behave, but I'm having real problems with the third. wget, curl and yum all fail to make their connections - that is, they all hang after ...
0
votes
0answers
60 views

wget show respond request output on console and write logfile in same time

How can I use wget to show a respond request on console, and also write them to logfile in the same time? wget --append-output=/tmp/LOGFILE.log "http://TESTSERVER:8080/PAGE/DATA" When I used ...
0
votes
2answers
90 views

Can't download from a https address using wget

I'm trying to download some videos from DefCon archive using wget but i'm getting this: Unable to establish SSL connection. I tried to use wget with --no-check-certificate but got the same result. ...
-1
votes
1answer
117 views

Perform HTTP request through non-default gateway (CURL? WGET?) [closed]

I have two ISPs /two routers on my LAN with Windows boxes. Switching default gateway (per PC) works fine, so I can choose my outgoing traffic from particular PC to be initiated from whichever ISP I ...
0
votes
1answer
457 views

SSL error curl/wget unknown protocol/wrong version number

I've been trying to use local hosted https urls in command line/cron jobs and i get those errors. curl output is similar. The same commands, when used in other servers works perfectly. Default ...
2
votes
4answers
2k views

Escape a ! in the password parameter of wget

I'm trying to execute something like this: wget --user=foo --password=bar! url The ! in the password is causing problems. I've tried escaping it with \, as in --password=bar\! I've tried ...
0
votes
1answer
43 views

How to download images from one server to another

I have a VPS running Centos. I also have a site (say, example.com) hosted on separate, shared hosting. I would like to backup all images in the "images" folder, which consist of the following ...
0
votes
4answers
140 views

wget ftp an entire site is very slow

I'm trying to wget an entire site to transfer from Server A to Server B. It works, but incredibly slowly. I tested this by uploading a 100mb psd file to my server, and grabbing it with wget ftp. ...
0
votes
1answer
203 views

Why would an HTTP(S) request not be logged in IIS?

I'm troubleshooting a batch file that uses Wget to send requests to a website running in IIS 7. The batch file runs Wget twice, the first time to login to the site via a POST, the second to run some ...
8
votes
1answer
19k views

Accessing a windows shared folder from Linux?

I am trying to copy a (.html) file from a Windows XP Professional shared folder onto a server running Ubuntu Linux 10.04 LTS. As it's a shared folder the usual 'wget' doesn't seem to work. I suspect ...
0
votes
1answer
49 views

cannot wget wordpress.org

I am not able to wget wordpress.org from server 63.143.51.2. I am able to wget other sites like google.com Error I am getting is as follows : [~]# wget wordpress.org --2013-04-12 01:42:17-- ...
0
votes
1answer
100 views

ldirectord NAT load balancing does not work with negotiate checks

I am using ldirectord for loadbalancing two HTTP servers. On the load balancer box i have the following network configuration: eth0 is used for internal purposes and does not take part in load ...
0
votes
1answer
501 views

Get a URL with variables via Linux Command Line

Sorry if this seems to be a very simple command, but I have been searching for hours without any solutions and exhausted my very limited knowledge of Linux. :-) I need to use some command to process ...
0
votes
1answer
330 views

How to check ip blacklist using curl/wget request to mxtoolbox?

I would like to add cron job to check server ip on blacklist. something like curl 'http://mxtoolbox.com/SuperTool.aspx?action=blacklist%3a142.11.193.83' | grep 'you are on a blacklist.' wget ...
1
vote
6answers
23k views

WGET can't resolve host

I've got 2 machines on the same sub-net running Debian 5.0. They use the same DNS (/etc/resolv.conf), they route to the same gateway (#route) and they have the same iptables settings (#iptables -L). ...
0
votes
1answer
825 views

wget - specify directory and rename the file

I'm trying to download multiple files and need to rename as I download, how can I do that and specify the directory I want them to download to? I know i need to be using -P and -O to do this but it ...
0
votes
2answers
2k views

Using wget to save sequential files as well as renaming the file extension

I run a cron job that requests a snapshot from a remote webcam at a local address: wget http://user:pass@10.0.0.50/snapshot.cgi This creates the files snapshot.cgi, snapshot.cgi.1, snapshot.cgi.2, ...
1
vote
2answers
52 views

Download and save a file with proof that it was downloaded from a specific server/url on a specific date?

Assuming the file was downloaded over http is this possible? I'm guessing there could be some way to do it using a hash and a timestamp however I'm not sure how you could prove nothing was tampered ...
0
votes
1answer
71 views

What could block the output of a command?

Sometimes I'll attempt a (2>&1) redirection and some/all of the resulting output appears to be silenced. e.g. wget -O- http://localhost/test.txt 2>&1 I would expect to see a merge of ...
3
votes
4answers
389 views

Download a file from the shell when button click is required

I have a link to a file that I would like to download from the shell. Unfortunately, the URL redirects to a software license agreement page which requires clicking an accept button. This is fine when ...
2
votes
2answers
7k views

Is there a built-in command-line tool under Windows like wget/curl?

I come from a Linux/Unix background and I have been wondering if Windows has a binary that can download files from the console. I would like to automate a certain process and one of my requirements ...
0
votes
3answers
103 views

input wget exclusions from a file?

i'm crawling a forum and I keep stumbling across certain threads that have been going on for ten years. i can certainly exclude these using wget option: -X ...
1
vote
3answers
306 views

error while executing bash script -> command not found

i made this script here, and get the error IA-exporto.sh: 13: wget: not found i tried changing the " by ` and mixed all together and rearranged, but it just won't do.. #!/bin/bash ...