Questions tagged [wget]
GNU Wget (or just Wget, formerly Geturl) is a computer program that retrieves content from web servers, and is part of the GNU Project. Its name is derived from World Wide Web and get. It supports downloading via HTTP, HTTPS, and FTP protocols.
14
questions
276
votes
6
answers
565k
views
how to download the ssl certificate from a website?
I want to download the ssl certificate from, say https://www.google.com, using wget or any other commands. Any unix command line? wget or openssl?
29
votes
4
answers
153k
views
Why wget doesn't verify SSL certificates?
I have a problem with my Fedora 8 installation. It looks that wget doesn't know how to verify SSL certificates any more. It's strange because I have another Fedora 8 box which I believe has the same ...
19
votes
5
answers
16k
views
Why is only one wget command working in my crontab?
I wish to fetch content from a PHP script on my server two times a day, altering a query variable lang to set what language we want, and save this content in two language specific files. This is my ...
10
votes
7
answers
45k
views
Wget, Curl, Yum Fail but Ping works - CentOS 5
We currently have three webservers.
Servers one and two behave, but I'm having real problems with the third.
wget, curl and yum all fail to make their connections - that is, they all hang after ...
0
votes
3
answers
504
views
How can I use wget to get files recursively if the username contains an @?
Firstly my main goal is to try and get FTP files recursively in Centos. However the actual FTP login contains an @ which ruins the syntax. Is there some way to place the username in "double quotes" ...
22
votes
4
answers
129k
views
Execute curl requests in parallel in bash
What is the best way to execute 5 curl requests in parallel from a bash script? I can't run them in serial for performance reasons.
9
votes
6
answers
203k
views
How to allow wget to overwrite files
Using wget command, how do I allow/instruct to overwrite my local file everytime, irrespective of how many times I invoke.
Let's say, I want to download a file from the location: http://server/folder/...
6
votes
4
answers
19k
views
Escape a ! in the password parameter of wget
I'm trying to execute something like this:
wget --user=foo --password=bar! url
The ! in the password is causing problems. I've tried escaping it with \, as in
--password=bar\!
I've tried ...
5
votes
5
answers
9k
views
Multithreaded downloading with shell script
Let's say I have a file with lots of URLs and I want to download them in parallel using arbitrary number of processes. How can I do it with bash?
2
votes
1
answer
4k
views
Using lynx or wget in cron to call a php script?
I'm examining a particular setup, and they have their crontab as follows:
0 * * * * lynx http://www.example.com/cron/scriptA.php
Of course, this relies on the 'security-by-obscurity' precept, ...
2
votes
1
answer
277
views
Why does the time it takes to run this script differ so much between user and system and how I might correct the discrepancy?
My application sits behind a load balancer, and every once in a while I like to do a status check on each machine to get an idea of the time it takes to return an index.html document on each machine.
...
1
vote
3
answers
4k
views
Downloading php files from python simple http server
I started python -m SimpleHTTPServer on one computer on lan and used wget to download php files from it to another. As far as i see, they seem to be downloaded correctly - i got php sources instead of ...
0
votes
2
answers
4k
views
wget works for all sites on the web but not the one hosted on that server
I currently have 2 Ubuntu 12.04 servers which are load balanced. If I go to anyone on them from the shell and type:
wget stackoverflow.com
The page is fetched into index.html. However, assuming ...
0
votes
2
answers
532
views
DNS issue on Fedora 12? wget wordpress.org fails where wget www.google.com works
I'm administering a Fedora 12 box, but am quite new to networking specifics. Recently one of our WordPress apps hosted on our server has stopped being able to perform its auto-update or auto-download ...