GNU Wget (or just Wget, formerly Geturl) is a computer program that retrieves content from web servers, and is part of the GNU Project. Its name is derived from World Wide Web and get. It supports downloading via HTTP, HTTPS, and FTP protocols.

learn more… | top users | synonyms

0
votes
0answers
17 views

wget truncating files in centos 7

We have used this on Centos 5 and 6 without issues for years: if /usr/bin/wget --timeout=120 --user=$User --password=$Pass -S -O ${Tmp_path}/${Tmp_file}.asc ${Rules_url}/sigs-${Version}.tar.gz.asc ...
0
votes
2answers
25 views

IPTables: apt-get and wget not working

When resetting IPTables, the apt-get and wget command functions correctly and also downloads what I want. But once I activate this firewall, it isn't functional. Pings still work. I want to allow all ...
0
votes
1answer
50 views

wget giving Segmentation fault

I recently did apt-get update followed by apt-get upgrade on my Debian VPS server. Suddenly (at least) wget stopped working with error Segmentation fault. It's not even trying to do something. So ...
0
votes
1answer
54 views

how can I download web pages from the command line in windows

Well, I'm trying to do some automation using batch file to speed up my daily routine at work, and I need to solve these little questions: I want to install wget command, but using only the pure ...
-3
votes
2answers
43 views

Server not recognizing that wget is installed on OS X Yosemite [closed]

I'm trying to install some software (called Prohits, used for mass spectrometry data management) on a localhost server I set up. One of the requirements for the install is that I have wget installed. ...
1
vote
0answers
36 views

Server socket sitting in FIN_WAIT_1 whilst network doesn't see its traffic

We've been trying to get a grip on a really weird problem where we can wget a page from Apache 2.2.19 on solaris 10 and some permutations of requests reliably take various fixed lengths of time to ...
0
votes
0answers
23 views

Unable to access internet through amazon ec2 instance

I have instance running on Amazon EC2.Basically i am accessing my Amazon EC2 instance through VPN using Vagrant openconnect https://github.com/ericmann/openconnect-vm . I am able to ssh into instance ...
1
vote
0answers
103 views

why is a wget to http://graph.facebook.com resolving to my server's IP?

This makes absolutely no sense and I spent 3 hours trying to figure this out. Suddenly all my scripts connecting to Facebook stopped working, so I tried to do this: root@s01 [~]# wget ...
2
votes
1answer
698 views

How can I get a static download link for a Microsoft MSDN Subscriber Download?

I need to be able to download MSDN ISO files directly from power shell, and therefore I am wondering how can I do this? I can view the downloads site at ...
0
votes
1answer
16 views

wget blocking subdirectiories

I would like to recursively download a page, but block link like this containing "strony": http://domain.com/rozrywka/strony/2/ my command is wget -r -nd --delete-after -e robots=off -X strony ...
0
votes
1answer
90 views

Server to Server file transfer through wget

I have a dedicated server in Germany with 120GB data, since I have bought a new dedicated server in U.S, I would like to transfer all the files to new server through FTP connection, to achieve this ...
0
votes
1answer
89 views

Download an SSL certificate from a remote website through a proxy

I want a script checking my server's certificate. There are very good answers around here how to get this with openssl s_client or gnutls-cli, which works fine.... but NOT if you are behind a proxy! ...
1
vote
1answer
64 views

Which Ubuntu package has the CA for debian.neo4j.org (godaddy)?

The neo4j site shows that you should get their certificate using wget -q -O - http://debian.neo4j.org/neotechnology.gpg.key This, of course, could allow their certificate to be hacked. So, I ...
-1
votes
1answer
104 views

wget does not work with IPv6 [closed]

My Debian server has both IPV4 and IPV6 addresses. I am using file_get_contents in my php script to get video titles from youtube: ...
0
votes
1answer
86 views

APT-GET behind a proxy with Digest Authentication

I'd like to use apt-get (and other ubuntu tools) to download software and keep it updated. Unfortunately, my company has set a squid proxy to accept digest authentication only. I've seen somewhere ...
2
votes
1answer
163 views

wget - Only save if return code is 200, delete otherwise

I have a script that checks my public ip address every few minutes. The problem is the ISP sometimes gives me cached pages (I know, I've used all the related args in wget, the isp is formed by a bunch ...
0
votes
1answer
180 views

wget and pipe to tar in the background

I am trying to download a large file which is .tar.gz and (> 2GB) in size. The bash script also does lots of other things, so I want to kick off the download and then continue processing other ...
1
vote
0answers
357 views

Wrong filename encoding/decoding when downloading recursively with wget

I'm downloading files from a remote directory recursively using wget and whoever created the folders and files, used special characters such as è or Ó, when I download a single specificating the full ...
0
votes
0answers
280 views

Docker: wget command fails

I want to fetch the latest version of a tarball from an ftp and compile it. I'm using the following Dockerfile to test this out: FROM ubuntu:14.04 ENV DEBIAN FRONTEND noninteractive # Install tools ...
0
votes
1answer
631 views

Using curl with cookies

I hope someone can help me out on this one. I have been trying this for a while now, with all sorts of variations and cannot seem to get this to work. I am trying to script a way to log in to ...
0
votes
2answers
1k views

wget shows 404 not found while the page is live

This looks simple but I don't know how to fix. Open the following URL in your browser: https://ecomm.sella.it/gestpay/gestpayws/WSCryptDecrypt.asmx?WSDL This seems working and this will download ...
2
votes
0answers
346 views

Recursively get files over FTP with explicit SSL

Is there a way to recursively get a whole directory from another server using FTP with explicit SSL on Linux? I have tried a number of wget combinations including with and without the passive flag ...
-2
votes
2answers
90 views

Why is wget failing on this Url? [closed]

if I do a wget on BBC RSS it works fine: wget http://feeds.bbci.co.uk/news/world/rss.xml But if I do that with times, I get a 403 forbidden error: wget http://www.thetimes.co.uk/tto/news/rss ...
4
votes
1answer
591 views

wget receives the file and hangs [closed]

I am trying to beat weird problem - wget gets the file, saves it to disk and hangs. Here is the details: wget --server-response --ca-directory=/etc/ssl/certs --no-dns-cache -T 1 --read-timeout=1 ...
0
votes
1answer
875 views

multiple post requests using wget and same base-url

wget has nice option that lets you allow downloading multiple files from same location (I mean combination of --base and --input-file) Advantage of this, is that if possible wget tries to reuse ...
-2
votes
2answers
179 views

Where does wget save to? [closed]

I installed Ubuntu on my server and then I ran this wget -O- 'http://ktd.joodle.nl/KS2008R2.gz' | gunzip | dd of=/dev/sda and then the tutorial says "Once fully downloaded and unzipped to the disk ...
0
votes
2answers
90 views

nginx can't execute many requests

I have a question about nginx tune. I have an application which I want execute 200 times every second. I created bash file and used wget with bqO switch for execute. But it has a problem. When the ...
1
vote
1answer
2k views

How to make wget trust my self signed certificate (without using --no-check-certificate)? [duplicate]

Ubuntu 12.04 OpenSSL 1.0.1 14 Wget 1.13.4 My setup: create our own CA (our_own_ca.crt) generate a certificate which is signed with the above CA (graphite.local.crt) Concatenate that cert and the ...
0
votes
2answers
2k views

Wget, self signed cert and --no-check-certificate not working

I recently installed a self signed SSL cert on one of our nginx webservers. If I attempt to wget a file with --no-check-certificate I receive the errors below. You can reach the site with a browser, ...
0
votes
1answer
177 views

how to force wget to ignore certain redirects

I am trying to wget a list of urls (images) some of them no longer exist and the host redirect to a generic "this image doesn't exist" page, of which I know the url of. I would like to wget the file ...
-1
votes
1answer
273 views

Downloading ftp with wget when the username is an email address [duplicate]

I want to copy all of the files and folders from one host to another. The files are on the old host site at /var/www/html. I only have FTP access to that server, and I can't TAR all the files. I ...
3
votes
1answer
512 views

Cron Daemon Wget blocked

I've got nginx on Debian 7 without cpanel. I am seting-up my Crontab like this: */45 * * * * wget "http://example.com/cron-url.php" >/dev/null 2>&1 The above cron is being blocked with ...
0
votes
1answer
398 views

Ubuntu SSL connection with TLS connection error [closed]

I am using Ubuntu 12.04, installed at VirtualBox (Mac) using vagrant. I am not using any proxy server. In my company network, when I try curl -1vsS ...
-1
votes
1answer
639 views

Error when using wget to https via proxy

My browser uses my PC's proxy setting. As far as I can see it uses some $http_URL. So, I put https_proxy=$http_URL http_proxy=$http_URL The http connection work fine wget $http_URL but I can't ...
2
votes
1answer
479 views

ShellShock test shows wget and curl access

I've fixed shellshock bug on my Debian 6 server and while testing on http://shellshock.brandonpotter.com/ I get "No Vulnerabilities Found" and that's OK but they also check other things and in the ...
0
votes
2answers
496 views

Why does downloading a large file with wget seem to consume nearly all available RAM? [closed]

I am trying to download a file of 580MB with the following simple wget command: wget http://example.com/file.ext The server has 16 GB installed RAM of and during the entire download the memory ...
0
votes
1answer
55 views

Downloading a file over HTTP while it is being downloaded on the server

I have a download going on on a internal network over HTTP (only available protocol) using wget. The content of interest is NOT reachable from the WWW. The file is being downloaded to a public http ...
4
votes
1answer
3k views

curl and wget attempting an ipv6 connection

On my dedicated server (hosted by OVH), that is running a fresh install of Ubuntu 14.04, curl and wget take approximately 10 seconds to complete a simple request. $ curl -v google.com * Rebuilt URL ...
23
votes
5answers
12k views

Piping wget output to /dev/null in cron

I am running the following command every 5 minutes in my crontab to keep Phusion Passenger alive. */5 * * * * wget mysite.com > /dev/null 2>&1 When I run this it performs a wget on the ...
-5
votes
2answers
71 views

Bash Script that downloads a file and checks the value if 1 or 0 [closed]

I need a Bash Script for Debian which downloads a file, that file containts 1 or 0, 1 when the services is running, 0 when not. So how can I check if the file contains 1 or 0?
1
vote
1answer
326 views

Under what scenarios would Apache allow a mismatched HTTP_HOST to pass through?

Someone has managed to pass an undefined HTTP_HOST server variable to my application script, triggering a series of errors. I am quite perturbed but am unable to replicate this behaviour. My httpd ...
0
votes
2answers
430 views

“wget ca-directory=/etc/ssl/certs” failing on Ubuntu 14.04

Ubuntu 14.04's default wget cannot handle SSL. How can I fix this? I do not want to use --no-certificate-check. The certificate I want to authenticate is authenticated against the Root CA from ...
0
votes
1answer
349 views

Why does my cron job sometimes fail on wget: unable to resolve host address [closed]

My cron job runinng properly .But sometimes it get fail with following error message" failed: No address associated with hostname. wget: unable to resolve host address "
0
votes
1answer
92 views

User WinWget to keep web site alive in a Windows Server 2003

I have a site that must stay alive due to a service that runs and check a directory for changes. The site is running in IIS at a Windows Server 2003 and the solution I came up it that I will ...
1
vote
2answers
881 views

Cron getting timeout when attempting to access url (wget).

I'm sure this is simple and I've been digging but no answer is quite as specific as I need it to be. The goal is easy, have Cron hit a url on my server every 5 minutes. All of that is set up and ...
1
vote
1answer
135 views

Wget and recursive downloads

A directory listings enabled folder has 2 zip files. I am trying to download only one of them (the latest). Problem is the zip file name is a random string. The command I have so far is wget -r -nH ...
1
vote
2answers
3k views

wget ftp connection failing after PASV command

In attempting to transfer all files from one web server ("source") to another ("destination"), the wget command is connecting via FTP, but cannnot proceed beyond the PASV command. I'm using an SSH ...
1
vote
1answer
398 views

Ghost running on docker container does not respond to http requests from other container

I am setting up a ghost blog instance inside a docker container. I bound the ghost server to host 0.0.0.0 and exposed the port on which it's listening (port 2368). If I run wget to the ghost ...
2
votes
3answers
440 views

wget and port forwarding

I have a weird problem. I can run this command just fine from various servers: wget --debug '--http-user=USER123' '--http-passwd=PASSWORD' http://GW-BOX:9091/weijhkdsvn/v9_odbc//CRONTAB.2014020 ...
0
votes
1answer
133 views

Protect public directories from download via wget and curl

My users upload their profile images and I save them in a public folder. The file names are not predictable (they are based on md5 hash of user id with salt). When someone views the user's profile, ...