Rsync is a fast and extraordinarily versatile file copying tool. It can copy locally, to/from another host over any remote shell, or to/from a remote rsync daemon

learn more… | top users | synonyms

-1
votes
1answer
14 views
+50

rsync --update --> warn if local file is newer

We use rsync --update to update files from a server to a laptop. The files on the laptop should not be modified. But the laptop gets used by several people, so a newcomer might think he can change ...
1
vote
1answer
2k views

rsync unexplained error & received SIGINT, SIGTERM, or SIGHUP

I created a batch script to back-up our server: #!/bin/bash user=$1 # create user dir ssh root@local.backup.tst -p 5774 mkdir -p /var/backup/server.tst/incremental/$user # backup mail dir rsync ...
11
votes
5answers
10k views

Execute rsync command over ssh with an ssh agent via crontab

i have a cronjob: 0 9 * * * rsync -a mydir remote_machine: i installed this with 'crontab -e'. i have an ssh-agent running, and when i execute the rsync command itself it works w/o any user ...
2
votes
4answers
2k views

Using Rsync to backup a Windows Share

I have a Windows 7 box that I want to back up to an Ubuntu machine. I have mounted a Windows share on the Ubuntu box (using CIFS/Samba), and I want to use a cron job to rsync what's on the mounted ...
1
vote
4answers
40 views

test when directories are in sync using rsync

Is there any way to know from a bash script when a rsync command does not download anything (aka the folder is in sync)?, I've tried using the exit code, but is only different when an error happens. ...
0
votes
0answers
7 views

How can I let rsync display both total and partial progress?

I've found that rsync's total progress is (somewhat) shown with --info=progress2, while partial progress (i.e. the current file) is shown with --info=progress (or -P). Is there a way to show both? ...
1
vote
0answers
15 views

Backup with local manifest [duplicate]

I use rsync to backup files to a remote server in a UNIX environment. As my local machine is the only one with write access to the backup files, I know the status of the backup files on the remote ...
3
votes
2answers
892 views

How to automate website deployments to production including minifying CSS/JS?

Currently I'm deploying my PHP website from staging to production using the following manual process: Minify CSS and JavaScript files using online YUI compressor tool. Move the original CSS and ...
0
votes
0answers
13 views

Limit Rsync bandwidth usage within Galera Replication

I would like to know, how can I limit the bandwidth usage of rsync within my MariaDB Galera Replication to avoid network choking. P.S. I can't find the rsyncd.conf in my Ubuntu 14.04. Is there any ...
1
vote
1answer
72 views

Dropbear equivalent to rsync with ssh proxy command

I am trying to guess the dropbear equivalent to this regular rsync command (using ssh with a proxy) rsync -avz --delete -e "ssh -o 'ProxyCommand ssh user@proxyhost exec nc %h %p 2>/dev/null'" ...
1
vote
2answers
46 views

Copy files from guest to host the first time with rsync using Vagrant

When doing vagrant up a "shell" provision download some files into the synced folder. Those files should be also copied to the host machine synced folder, so that the project would be available from ...
2
votes
1answer
30 views

How to capture Rsync temp files? [closed]

I want to use Rsync to do incremental backup, and my aim is to store the latest change separately. I found Rsync has a temp file path to store the change, but it automatically delete the temp file ...
1
vote
2answers
1k views

s3fs Input/output error

I'm trying to set up a backup system with s3fs and the Amazon S3 service. I followed this this guide and this guide. Tailing /var/log/messages I get: Aug 28 13:37:46 server s3fs:###response=403 I ...
-1
votes
0answers
15 views

Sync local dir to FTP without checking file status on server [duplicate]

I'm using Mac OS X (Yosemite) and I want to sync a local folder to remote folder over FTP. At the moment I'm using lftp, and it is syncing the directories fine, but it takes a lot of time since my ...
1
vote
2answers
29 views

Bash script rsync --include-from fail

I have writted a bash script to backup folders and files from a machine to our backup server. My goal is to exclude all the files older than 6 months from this weekly backup. To do that, I used a find ...
2
votes
1answer
1k views

easy way to restore incremental rsync backup?

I have incremental rsync backups of a folder, created with: rsync --delete -a -v --backup --backup-dir="../backup_`date +%Y-%m-%d`" /orig /backups/dest so I have a copy of current /orig on ...
1
vote
1answer
25 views

Rsync over ssh folder depth limit?

i'm working on a server migration and run into the following problem: I'm running rsync to migrate all the data but for some reason there is a folder depth limit... This is done via rsync over ssh ...
1
vote
1answer
977 views

rsync error on Downloading

I am trying to setup a Rsyncmirror on my mount drive /mnt/Mirror/ubuntu_mirror, so I am trying the command: rsync -a --bwlimit=128 rsync://archive.ubuntu.com/ubuntu /mnt/Mirror/ubuntu_mirror but it ...
0
votes
0answers
17 views

rsync: --compare-dest on remote folder

I have: DirA (local folder) (/data/*) DirB (local diff folder) (/tmp/diff) DirC (remote folder) user@XX.XX.XX.XX:/data/ DirA is always the most up to date. I rsync from DirA to DirC, but now ...
0
votes
1answer
29 views

Remote Ubuntu Server Back-up

I want to move all my data(incl. software and settings) from one VPS to another. I'm currently using a remote Ubuntu server. How can I make a full system image back-up and restore it in a new Ubuntu ...
6
votes
2answers
2k views

Can rsync display current average speed?

When I'm transferring large quantities of data using rsync, it would be helpful if I could have the average speed up until now at a glance, rather than a bunch of different speeds for each file.
1
vote
1answer
1k views

How do I get rsync to listen on two different ports via xinetd?

I have multiple servers that receive files via rsync on different ports. I'd like to merge them into the same physical server and let the clients continue to direct their files to the same port they ...
0
votes
0answers
24 views

Ubuntu 12.04 LUKS/dmcrypt disk to disk copy freezes

I have 2 external USB hard drives encrypted with LUKS in Ubuntu 12.04. Generally, the both drives are very slow with LUKS/dmcrypt, e.g. 7 MB/s for both read/write, but I could live with this. ...
0
votes
1answer
9 views

rsync: syncing source folders with deletion, leave existing destination folders alone

I am dealing with the following folder structures on both ends of the rsync: Source Controllers Plugins - Plugin1 - Plugin2 - Plugin3 Models Destination Controllers Plugins - Plugin4 - Plugin5 - ...
7
votes
1answer
8k views

What exactly will --delete-excluded do for rsync?

I use rsync with great pleasure for backing up my servers, although I do have a question about the --delete-excluded parameter. /usr/bin/rsync -a --delete --numeric-ids --relative --delete-excluded ...
-2
votes
2answers
77 views

How to make rsync delete destination directories no longer existing at source? [closed]

I have hard drive that I back up with rsync to a network-attached storage. There are some non-empty directories at the destination (the nas) that do not exist on the source anymore. It is not a ...
2
votes
1answer
40 views

Cobbler import failing

I've been playing with Cobbler lately (on a CentOS 7 distrib), and I've gone through an error while importing a CentOS 7 iso. I've been able to find a work around to the problem, and I thought it'd be ...
0
votes
0answers
12 views

rsync copy > server unreacheable

I'm using rsync to copy around 500GB of data (Nexus repositories). The idea is to run it every hour to backup the "delta" and in case of issues we can easily switch the disks. Now, for two days in a ...
0
votes
0answers
15 views

Permissions for copying files between datacenter machines?

I frequently run experiments in EC2 where e.g. I will check out a VM similar to our database and will want to load the production dataset into it for experimentation. I have to copy the dataset onto ...
2
votes
2answers
986 views

Does rsync support multiple sources to a given destination in parallel

If I have multiple sources, each with the same directory tree, but different files in the tree, is it safe to run multiple rsync commands in parallel with the same destination? Specifically, will ...
1
vote
2answers
59 views

Get Zipped Logs from a Remote Server

I am tasked with trying to find a way to download zipped logs from a remote server. There are quite a bit of these logs and they are constantly created. I do have limited ssh access to the remote ...
1
vote
2answers
5k views

How do I manually install and update plugin in OpenVAS3 without rsync?

I've been assigned a task of penetration testing a server using OpenVAS3. However, I am behind a corporate firewall and OpenVAS3 uses rsync to perform updates from rsync://rsync.openvas.org:/nvt-feed ...
1
vote
1answer
1k views

rsync from Drobo to Drobo

I'd like to run a backup rsync job from one Drobo to another. I've managed to get rsync and the ssh tools installed so that I can ssh from my desktop into backup@drobo1.local and then ssh into ...
0
votes
1answer
252 views

Explain this rsync script for me - Linux backups

I don't know Linux and even less about programming so pardon my ignorance. I have this script and would like someone to explain the internals to me. I understand that the syntax of: 30 1 * * * ...
0
votes
3answers
1k views

How can make rsync use sudo

I use rsync to mirror a number of folders on our failover server. However, some of our files, such as thumbnails or full-text indexes, are generated by our applications under the web user (named ...
0
votes
1answer
49 views

rsync with --backup

I'm trying to rsync a single directory of files and store timestamped revisions at the destination. This is what I'm using at the moment: rsync --verbose --progress --stats --compress --no-whole-file ...
0
votes
1answer
114 views

Why is FileZilla SFTP file transfer max capped at 1.3MiB/sec instead of saturating available bandwidth? rsync and WinSCP are even slower

I'm downloading from a server and downloads are maxing out at 1.3MiB/second with FileZilla but I can start concurrent downloads and they will download at 1.3MiB/second also. So why can't I download ...
0
votes
1answer
18 views

Exception reporting with rsync backups?

I run rsync in the cron every 4 hours. This works well for backups, but it generates six messages a day to root for each successful backup. I know I can put the output to /dev/null not to get any ...
1
vote
1answer
48 views

What rsync options to use for the below mentioned scenario?

Greetings !!! This is regarding a specific requirement about rsync that we are trying to achieve. We have tried to achieve this by using various rsync options. However, we are encountering different ...
2
votes
2answers
616 views

rsnapshot: WARNING: Some files and/or directories in / vanished during rsync operation

I once in a while get this message in my rsnapshot log, and an identical message in /var/log/messages. Unfortunately, there is no other deviation from normal output, despite loglevel 5 in ...
61
votes
15answers
57k views

Showing total progress in rsync: is it possible?

I have searched for this option already, but have only found solutions that involve custom patching. The fact that it does not show in --help and no more info can be found probably indicates the ...
15
votes
13answers
10k views

Complete restore of linux system

I am familiar with using rsync to back up various files from my system but what is the best way to completely restore a machine. What I have tried in the past is: Do a basic format/reinstall from ...
0
votes
0answers
34 views

backing up millions of files and 1 tb [duplicate]

I'm trying to find a fast solution that can transfer about 3 million files taking up about 1tb of space. So far after a bit of research my choices seem to be lftp and rsync. Which option would work ...
0
votes
2answers
739 views

Failover tmpfs mirroring. Am I doing it right?

My goal is to have a certain directory to be available as tmpfs. There will be some modifications during server uptime in this dir and those modifications must be synced to non-tmpfs persistent dir on ...
7
votes
2answers
2k views

Get list of transferred files from rsync?

I'm currently using rsync on a script that deploys a PHP application from a staging to a production server. Here is how: rsync -rzai --progress --stats --ignore-times --checksum /tmp/app_export/ ...
0
votes
1answer
26 views

Maintaining rsync log file

I have a cron running rsync for backup purposes, and rsync logs the output to a file via --log-file. This script will keep on running for a quite long time and I am worried that the log file will keep ...
4
votes
5answers
5k views

Rsync Remote to Remote

I'm looking for a solution for using rsync between 2 remote servers. It seems like its not possible. Does any one know why its not possible? I ask that because I think if I know the reason, maybe I ...
8
votes
6answers
20k views

Is there any other reason for “no space left on device”?

I am using Dirvish on a Ubuntu server system for backing up a hd to an external usb 3.0 drive. Until a few days ago, everything worked fine, but now every backup fails with "no space left on device ...
0
votes
3answers
117 views

rsync : write failed - No space left on device (28)

I want to rsync a folder from one server to another. But rsync synchronization fails: $ rsync -zr --compress-level=9 --delete /var/www/mywebsite/current/web/js login@192.168.1.4:/srv/data2_http ...
1
vote
1answer
367 views

resumable tar over ssh

I'd like to use tar cf - | ssh user@hostname tar xf - to copy a very large set of files. The only problem is that it will be over a very flakey VPN link. Is it possible to somehow set up a resumable ...