Questions tagged [wget]

GNU Wget (or just Wget, formerly Geturl) is a computer program that retrieves content from web servers, and is part of the GNU Project. Its name is derived from World Wide Web and get. It supports downloading via HTTP, HTTPS, and FTP protocols.

Filter by
Sorted by
Tagged with
0
votes
0answers
12 views

Resuming download from multiple sites

Looking for any tools which downloads the single file hosted in different multiple websites matching the same size, version, name which includes matching AOO, KEYS and PGP/ASC keys and having SHA256 / ...
0
votes
0answers
23 views

scripting download of teradata files

I'm trying to automate the build of a server and am having troubles scripting out the download of the teradata tools and utilities for linux from this site https://downloads.teradata.com/download/...
0
votes
1answer
21 views

How To Use Wget Command To Check Server Cache Settings

I'm having trouble with a server side cache with an OpenLiteSpeed server. I've tried the following .htaccess trick to try and turn this cache off. Can you tell me a wget command I can use to test my ...
0
votes
1answer
13 views

wget specific directory with downloading whole path

I try to download data using this command. wget -r --no-parent http://myserver/username/data/ This leaves me with three folders on my server, namely: myserver/username/data/ How do I download only ...
0
votes
2answers
102 views

Use wget on a cluster with ssh-tunnel [closed]

Normally I can sercure copy files from one machine to another using > scp -oProxyJump=user@login.node.org ssh user@main.node.org:/home/user/my_files/* . which is very slow for large data sets. I ...
0
votes
2answers
41 views

Why ping statment doesn't work on this Linux Ubuntu VM? [closed]

I am not so into networking and I have the following doubt. They provide me a Linux Ubuntu 18.04.3 LTS VM on which I have to install some tools. The first thing that I tried was related to the ...
0
votes
0answers
119 views

wget: unable to resolve host in ubuntu. Starts working after a reboot

we have an API which has been exposed by another team in the company (say, api.internal.company.com). This API is only accessible from internal network, and is not accessible via. the internet. ...
0
votes
1answer
74 views

Connect to ubuntu port from docker container

I have a application running on port 8180 on my local machine When I try to wget http://192.168.1.12:8180/auth from docker container, I get following error --2019-10-10 08:17:03-- http://192.168.1....
0
votes
1answer
39 views

How can I force `wget` to clobber a previously-downloaded file?

I'm trying to force wget to clobber a download and I haven't been able to make it do it with what I can find in the man pages. I'd like something cleaner than writing to and redirecting STDOUT. Anyone ...
1
vote
1answer
255 views

PASV FTP fails for wget/ftp but works for curl/lftp

I have a server running Centos 7 and vsftpd-3.0.3 (installed from source to get the latest version, though everything I describe was also applicable to the vsftpd-3.0.2 version that was previously ...
0
votes
0answers
67 views

wget recursive downloads follow redirections

I migrated my website serving static files to a new domain with new directory structures, but I still want the old URLs to work, because I can't migrate all my download scripts to point to the new ...
6
votes
1answer
267 views

Why does Amazon Linux 2 have older version of wget vs. Amazon Linux 1?

We noticed that wget on Amazon Linux 2 is v1.14, but on the older version of Amazon Linux, it was v1.18. Any idea why this would be? I'm fairly certain we installed from yum in both cases. Is there ...
0
votes
1answer
171 views

Git clone, wget, ping not working on GCP server all of a sudden

My Google Cloud Platform server is suddenly unable to download anything via wget, git clone, and unable to apt-get install anything. --2019-05-07 14:48:02-- http://google.com/ Resolving google.com (...
-3
votes
1answer
748 views

Can I assign the special IP address when I use wget?

I have a multi-IP addresses Server, a main IP 102.1.1.1 and a C segment 103.1.1.0/24 IP addresses on it. when I use wget www.google.com can I assign my special ip address in my Server like ping? ...
0
votes
0answers
2k views

CentOS 7: curl and wget not working

My problem is that curl and wget usually fail to retrieve more than just the first part of any given file, and often nothing at all. Both have worked previously on the same server, and nothing else on ...
1
vote
1answer
478 views

Upgrading wget on Ubuntu 16.04 server

I'm trying to upgrade my copy of wget on the server. Currently its running: 1.17.1-1ubuntu1.4 The problem is that I need 1.19 so I can get a new feature: http://tomszilagyi.github.io/2017/02/Wget-...
18
votes
6answers
7k views

Why the discrepancy between Speedtest and Wget?

My customer complains about low internet speeds. When measured with Speedtest.net speeds are acceptable. Periodic measured downloads are 10% to 30% of the nominal speed. I cannot explain that. Some ...
4
votes
2answers
3k views

Why does curl work with a specific https site, but wget has problems with certificates?

Centos 6. After updating recently ca-certificates I run into some troubles. I have the most recent versions of curl for centos 6: -bash-4.1$ curl -V -v curl 7.19.7 (x86_64-redhat-linux-gnu) libcurl/7....
0
votes
0answers
72 views

create Linux user to give only wget permission

I own a dedicated server and I'm working on my server along some colleagues. I want to create some users for my colleagues which only be able to use wget command. I mean I don't want to give them ...
2
votes
2answers
205 views

`wget`-ting a website for “local” browsing on a different domain

I need to mirror a website and deploy the copy under a different domain name. The mirroring procedure should be all automatic, so that I can update the copy on a regular basis with cron. The mirror ...
0
votes
2answers
839 views

What does the -c in wget -c Linux command mean?

I am installing Artifactory on an Ubuntu server, and trying to add JFrog repository key. The command is: wget -c -O- "https://bintray.com/user/downloadSubjectPublicKey?username=jfrog" | sudo apt-key ...
2
votes
1answer
407 views

Automated export of phpMyAdmin SQL download with wget

I'm using the following script to attempt to download an SQL export from a phpMyAdmin installation (adapted from this Stackoverflow question) read -p "Username: " USERNAME read -p "Password: " ...
2
votes
0answers
6k views

How to Enable JavaScript for wget in linux for grabbing a website?

I use wget like this for save site : wget --page-requisites --no-parent --mirror http://example.com/index.html -P /home/ in Some cases It does NOT work, Error is : This site requires Javascript to ...
3
votes
3answers
10k views

Fixing wget certificates

Basically, I was testing different versions of OpenSSL, and somewhere in the process broke wget's path to certificates. wget https://www.google.com Results now in: ERROR: cannot verify www.google....
0
votes
1answer
1k views

wget download only certain folders from site

I want to download this site with wget, and to do this I'm using this command: wget.exe --no-clobber --no-parent -r --convert-links --page-requisites -U Mozilla "http://www.s-manuals.com/smd/" That'...
0
votes
1answer
3k views

Why can't I get wget to pipe standard output to /dev/null?

When I run this command it works as expected: wget -p https://www.google.com/ After running this command I check the error code with echo $? This returns 0, indicating that last command ran ...
-1
votes
1answer
85 views

stdout and stderr from bash execution to other machine?

Is it possible to send stderr or stdout from a linux machine to ubuntu linux machine using at best wget or other common package at worse ( hopefully not ssh access ) ? So far i can find a way to "...
2
votes
1answer
846 views

wget hangs/freezes when downloading file into NFS

I'm running some experiments with Amazon EFS (General purpose) and EC2 and I have the issue that EFS seems to act unstable. Commands that involve the mounted file system would hang or freeze. For ...
0
votes
1answer
406 views

Using wget to download GlobColour data from hermes ftp server

I want to download the netCDF products from ftp://ftp.hermes.acri.fr. I used wget in cygwin package for Windows systems. My link address for accessing to the data is ftp://ftp.hermes.acri.fr/691969751 ...
0
votes
1answer
478 views

FTP access error in EC2

I have 2 servers with windows and ubuntu running in Amazon EC2. I created the FTP server using plesk in windows and used vsftpd in the ubuntu. I have enabled all TCP ports in both the servers. The ...
3
votes
1answer
2k views

How to download a file and preserver original permissions using wget

How can I download a file that has already executable permissions 755 in another server. I want to: wget https://example.com/pub/register.sh --no-check-certificate and preserver permission register....
3
votes
3answers
4k views

nginx block curl and wget

I have nginx webserver. I have a rich content site and i found that some malicious bots are trying to crawl my content. I blocked any curl or wget coming to my site like this if ($http_user_agent ~* ...
0
votes
0answers
332 views

(mac) Need to automatically backup entire FTP server and create an archive

Is there a way to grab all files from an FTP server using wget (or similar), then create a zip or tar of the downloaded files? I would like to do this with one command or using Automator, and to ...
3
votes
1answer
6k views

Cannot get cURL or wget to validate some SSL certificates

I've noticed that our link checker, which uses cURL, fails more and more often to validate SSL certificates. I'm trying to get to the bottom of this. https://www.bgetem.de/, for instance, opens just ...
-1
votes
1answer
47 views

Stop wget clobbering local file is server unavailable

I have a cron job on a server which once a day uses wget to download "Earth Orientation Parameters" and leapsecond data from a NASA server. Specifically: wget https://gemini.gsfc.nasa.gov/500/oper/...
0
votes
0answers
814 views

Download WordPress site via wget

We have a unique situation whereby we are going to be hosting a website within a company's private network. They have given me RDC access. However, the remote machine has no internet access, so I am ...
2
votes
1answer
727 views

How to set index.html to redirect wget query to an other page/file?

If my server is at example.com, running $ wget example.com will only download the file index.html. How can I make wget either download another file instead of index.html download this file along ...
1
vote
0answers
2k views

How to use wget with redirect and long URL?

I am trying to download the latest release of a web application from GitHub using wget on the shell. As far as I remember, I never had any trouble with wget. I issue the following command: wget '...
1
vote
0answers
658 views

How to set http_proxy env variable and have wget using it transparently before login (Debian)

By setting environment variable http_proxy="http://proxy-server" I'm able to call programs like wget, curl, etc, using the set http proxy transparently. To persist this to the whole system I've added ...
1
vote
0answers
24 views

Start script are not cleared table of processes

I have a proxy server, all ok. But, i have some problems & questions. First: when i make "/etc/init.d/nginx stop" or "/etc/init.d/nginx restart", of my config, it not reload and all nginx process ...
1
vote
1answer
1k views

Changing all HTML absolute links to relative [closed]

I have a website that has a bunch of absolute addresses, and I need to move it (the whole contents of that website) up a level, so all of the absolute links need to be converted to relative. I know ...
0
votes
3answers
8k views

Running wget as cron job [duplicate]

I want to download backup archives from one server to another. The server has a script that delivers the latest backup archive, the file has specific name for each date. I want wget to preserve that ...
-2
votes
1answer
319 views

SSH/SCP works but not wget

There are two machines: Build: Using jenkins to get code and build war files Deploy: used for deploying the war files to a tomcat server for testing. I am trying to do automatic updates for the war ...
0
votes
1answer
736 views

URL encoding issue with cron and wget

I have a simple bash script: #!/bin/bash wget -q 'http://requestb.in/1fq0r3s1?foo=a%2Bb' -O /dev/null If I run this from the commandline and then inspect at http://requestb.in/1fq0r3s1?inspect I ...
0
votes
1answer
3k views

vshpere wget: bad address 'releases.ubuntu.com'

on a raw vsphere esxi 6 without any vm installed i have to setup vm's and ... remotely so i decided to open ssh to esxi and download an Ubuntu iso using wget this way: wget http://releases.ubuntu....
0
votes
0answers
629 views

Download file from server using a command line

I have 2 different servers, I put my mp3 files in server1, and I am testing to download them from server2 using the wget tool: wget "http://www.example.com/Path-to-mp3-file" I have 2 results: 1) If ...
1
vote
0answers
90 views

Can wget detect remote duplicate files (with different names) and download only one?

I'm retrieving a dynamic website contents recursively. Unfortunately, files are available from different dynamic URLs. For instance, maybe file http://foo.bar/bla.php?q=xyz and http://foo.bar/bla....
1
vote
1answer
733 views

How do I ensure that a CoreOS cloud-config service is able to download files?

I am defining a one-shot service in my CoreOS cloud-config, but it is failing due to not being able to download files from Google Cloud Storage (via wget): Apr 13 11:09:56 staging-node-ys9y.c....
0
votes
2answers
1k views

IPTables: apt-get and wget not working

When resetting IPTables, the apt-get and wget command functions correctly and also downloads what I want. But once I activate this firewall, it isn't functional. Pings still work. I want to allow all ...
1
vote
1answer
5k views

wget giving Segmentation fault

I recently did apt-get update followed by apt-get upgrade on my Debian VPS server. Suddenly (at least) wget stopped working with error Segmentation fault. It's not even trying to do something. So ...

1
2 3 4 5 6