Rsync is a fast and extraordinarily versatile file copying tool. It can copy locally, to/from another host over any remote shell, or to/from a remote rsync daemon

learn more… | top users | synonyms

0
votes
1answer
28 views

Ansible synchronize hangs when executing inside ssh with delegate_to

The following task works fine when run directly from my machine. When I run it from a remote machine through SSH it hangs forever. This is the task: - name: deploy public directory ...
0
votes
1answer
11 views

Why is glusterfs renaming files during rsync import?

While searching for an error after failed initial rsync of data to glusterfs I found the following entry in /var/log/glusterfs/data-nfs.log: [MSGID: 109066] [dht-rename.c:1410:dht_rename] ...
1
vote
0answers
18 views

rsync crashes machine while performing sync on glusterfs mounted share

I am running ubuntu 14.04 as guest inside virtualbox 5.0.3 on OS X. While performing rsync on a glusterfs (3.7.x) mounted share with over 100.000 files, the entire machine crashes. There is one ...
-1
votes
0answers
22 views

Is rsync reliable for syncing uploaded files of a LAMP-Application on 2 servers?

We are currently designing the architecture for a High Availability setup of our LAMP application. The last critical question is, how to access the user uploaded images on server 1 from server 2 and ...
0
votes
2answers
22 views

How to transfer data between s3 buckets of the different aws account using command line

How to transfer data between s3 buckets of the different aws account using s3cmd ? command will be like this: s3cmd rsync s3://acc1_bucket/folder/ s3://acc2_bucket/folder --recursive But then how ...
1
vote
0answers
13 views

Only move folders not existing in target directory [migrated]

I am looking for a way to move folders that are not already present in the target directory on my linux server. Example: Target directory folder1 folder2 folder3 folder4 Source directory folder1 ...
2
votes
2answers
29 views

Linux: Detecting/thwarting system modification or use of single user mode

Working through a backup solution and could use some security assistance. Please see below. The process For our editing business, we have an offsite backup server that we update nightly using rsync ...
0
votes
0answers
20 views

rsync: Exclude all, include some and exclude sub-dirs

In the past I had a couple of scripts that used rsync to sync a lot of stuff from remote locations to a local HD. I had it setup in the way that, I created a excluded.txt and included.txt file for ...
2
votes
1answer
25 views

passing additional parameters to rsync using rsnapshot

I have my backups being performed by rsnapshot, works well. EXCEPT, on one of the jobs for the /home volume I'd like rsync to copy the sym-links as physical directory/files. I believe the parameter ...
0
votes
1answer
73 views

Rsync shell script permission error on destination server

So this is my first bash script attempt, and I am trying to rsync a project folder on OS X to a development server running ubuntu 14.04. I get some permission errors on the destination server when I ...
0
votes
1answer
48 views

sporadically, rsync takes exceptionally long

We do backups with rsync like this: rsync -axH --inplace --delete --delete-excluded \ --exclude-from=excludes --stats \ --link-dest="${previous?}" "${source?}"/ "${dest?}"/"${stamp?}" $previous ...
1
vote
2answers
21 views

How to prevent rsync from chown'ing remote users files

I'm doing rsync /local/path/to/src user1@remote:/path/to/dest. dest belongs to user2@remote. How do I keep rsync from chown'ing dest to user1 after syncing? Please note that I have already tried ...
0
votes
1answer
33 views

Best way to keep servers in sync without any broken/missing files between syncs

I'm assuming this is the right place to ask this sort of question, but please don't shoot me if I should have gone to a different Stack Exchange. Anyhoo, what would you say the best way to keep ...
1
vote
1answer
33 views

Rsync fails to set the proper uids

I try to rsync a folder from server A to server B: rsync -aAXSHPr --numeric-ids --fake-super --delete --delete-after --delete-excluded -e "ssh -i key" root@1.2.3.4:/home/vmail/ /home/vmail/ rsync ...
0
votes
0answers
6 views

Why isn't ownership preserved with “rsync -a” on my Mac? [migrated]

I am copying files from an internal disk to an external one attached by USB (both are formatted as Mac OS Extended (Journaled)): root# rsync -avi /Volumes/int_hd/ /Volumes/ext_hd/ All directories ...
0
votes
0answers
15 views

Solaris run rsync after logadm

I'm trying to get this logadm configuration running. '/dir1/*/*/alert*.log' -C 8 -c -s 10m -t '$file_%Y-%m-%d' -z 0 -a '/usr/bin/rsync -qp /dir1/*/*/alert*.gz ...
0
votes
2answers
26 views

unison or Rsync for session files

In my cheap config I am using 2x app servers and 1x DB server. My question now is what I should use in order to sync session files between the servers for my php app? Is unison or Rsync good here, ...
0
votes
0answers
13 views

Can rsync be made to write to the target of a symlink on the destination?

If I'm rsyncing a directory, like this on the source: foo/ (real dir) bar (real file) and on the destination, bar is actually a symlink to <some other file>, like: foo/ (real dir) bar ...
0
votes
1answer
46 views

How to rsync to remote machine with user1 for ssh and user2 as remote rsyncer?

UPDATE: it seems I have to use rsync modules. So I created a very simple rsyncd.conf in the home of user2 on the remote server with: [test] path = /dest It does not work, but the problem seems ...
0
votes
1answer
41 views

bash rsync is Killed by signal 2

Problem: I am trying to prevent the user to cancel the script by using ctrl + c. The following script executes completely, except rsync that insists on dying, displaying the error "Killed by signal ...
0
votes
2answers
48 views

rsync - How can I exclude from all instances of a file while using relative paths for each file?

I am coding a deployment script that uses rsync to sync cloned repository files with a website target directory. I am trying to allow my users the ability to place a .exclude file anywhere in their ...
0
votes
3answers
58 views

Multiple servers Rsync into one NAS simultaneaus

Scenario: 1 NAS at our main office (Synology Cubestation CS407) 20 remote servers in various physical retail stores (1 server per store) Network between HQ and stores are in an MPLS/VPN. I have ...
1
vote
0answers
60 views

What is a fast, efficient method for threading rsync

I have a single root directory (on a NAS) that I need to backup to another server. The hierarchy of the directory is several layers deep and a majority of the data is composed of extremely large ...
0
votes
0answers
16 views

prevent rsyslog to duplicate logs

my rsyslog writes on secure and on messages i have this *.info;mail.none;authpriv.none;cron.none /var/log/messages authpriv.* ...
-1
votes
1answer
33 views

Rsync, logging the names of files sent

I'm sending files using rsync from server A to B. Server B has limited storage, so once the files are sent, they are copied and deleted. So using rsync's --ignore-existing won't work in this case. I ...
0
votes
2answers
58 views

rsync --update --> warn if local file is newer

We use rsync --update to update files from a server to a laptop. The files on the laptop should not be modified. But the laptop gets used by several people, so a newcomer might think he can change ...
0
votes
0answers
13 views

How can I let rsync display both total and partial progress?

I've found that rsync's total progress is (somewhat) shown with --info=progress2, while partial progress (i.e. the current file) is shown with --info=progress (or -P). Is there a way to show both? ...
1
vote
4answers
51 views

test when directories are in sync using rsync

Is there any way to know from a bash script when a rsync command does not download anything (aka the folder is in sync)?, I've tried using the exit code, but is only different when an error happens. ...
1
vote
0answers
16 views

Backup with local manifest [duplicate]

I use rsync to backup files to a remote server in a UNIX environment. As my local machine is the only one with write access to the backup files, I know the status of the backup files on the remote ...
0
votes
0answers
32 views

Limit Rsync bandwidth usage within Galera Replication

I would like to know, how can I limit the bandwidth usage of rsync within my MariaDB Galera Replication to avoid network choking. P.S. I can't find the rsyncd.conf in my Ubuntu 14.04. Is there any ...
1
vote
1answer
100 views

Dropbear equivalent to rsync with ssh proxy command

I am trying to guess the dropbear equivalent to this regular rsync command (using ssh with a proxy) rsync -avz --delete -e "ssh -o 'ProxyCommand ssh user@proxyhost exec nc %h %p 2>/dev/null'" ...
2
votes
1answer
41 views

How to capture Rsync temp files? [closed]

I want to use Rsync to do incremental backup, and my aim is to store the latest change separately. I found Rsync has a temp file path to store the change, but it automatically delete the temp file ...
1
vote
2answers
229 views

Copy files from guest to host the first time with rsync using Vagrant

When doing vagrant up a "shell" provision download some files into the synced folder. Those files should be also copied to the host machine synced folder, so that the project would be available from ...
1
vote
2answers
43 views

Bash script rsync --include-from fail

I have writted a bash script to backup folders and files from a machine to our backup server. My goal is to exclude all the files older than 6 months from this weekly backup. To do that, I used a find ...
1
vote
1answer
49 views

Rsync over ssh folder depth limit?

i'm working on a server migration and run into the following problem: I'm running rsync to migrate all the data but for some reason there is a folder depth limit... This is done via rsync over ssh ...
0
votes
0answers
35 views

rsync: --compare-dest on remote folder

I have: DirA (local folder) (/data/*) DirB (local diff folder) (/tmp/diff) DirC (remote folder) user@XX.XX.XX.XX:/data/ DirA is always the most up to date. I rsync from DirA to DirC, but now ...
0
votes
1answer
56 views

Remote Ubuntu Server Back-up

I want to move all my data(incl. software and settings) from one VPS to another. I'm currently using a remote Ubuntu server. How can I make a full system image back-up and restore it in a new Ubuntu ...
0
votes
1answer
62 views

Ubuntu 12.04 LUKS/dmcrypt disk to disk copy freezes

I have 2 external USB hard drives encrypted with LUKS in Ubuntu 12.04. Generally, the both drives are very slow with LUKS/dmcrypt, e.g. 7 MB/s for both read/write, but I could live with this. ...
0
votes
1answer
18 views

rsync: syncing source folders with deletion, leave existing destination folders alone

I am dealing with the following folder structures on both ends of the rsync: Source Controllers Plugins - Plugin1 - Plugin2 - Plugin3 Models Destination Controllers Plugins - Plugin4 - Plugin5 - ...
2
votes
1answer
107 views

Cobbler import failing

I've been playing with Cobbler lately (on a CentOS 7 distrib), and I've gone through an error while importing a CentOS 7 iso. I've been able to find a work around to the problem, and I thought it'd be ...
0
votes
0answers
15 views

rsync copy > server unreacheable

I'm using rsync to copy around 500GB of data (Nexus repositories). The idea is to run it every hour to backup the "delta" and in case of issues we can easily switch the disks. Now, for two days in a ...
0
votes
0answers
16 views

Permissions for copying files between datacenter machines?

I frequently run experiments in EC2 where e.g. I will check out a VM similar to our database and will want to load the production dataset into it for experimentation. I have to copy the dataset onto ...
0
votes
1answer
19 views

Exception reporting with rsync backups?

I run rsync in the cron every 4 hours. This works well for backups, but it generates six messages a day to root for each successful backup. I know I can put the output to /dev/null not to get any ...
0
votes
1answer
240 views

Why is FileZilla SFTP file transfer max capped at 1.3MiB/sec instead of saturating available bandwidth? rsync and WinSCP are even slower

I'm downloading from a server and downloads are maxing out at 1.3MiB/second with FileZilla but I can start concurrent downloads and they will download at 1.3MiB/second also. So why can't I download ...
0
votes
1answer
60 views

rsync with --backup

I'm trying to rsync a single directory of files and store timestamped revisions at the destination. This is what I'm using at the moment: rsync --verbose --progress --stats --compress --no-whole-file ...
-2
votes
2answers
125 views

How to make rsync delete destination directories no longer existing at source? [closed]

I have hard drive that I back up with rsync to a network-attached storage. There are some non-empty directories at the destination (the nas) that do not exist on the source anymore. It is not a ...
1
vote
1answer
73 views

What rsync options to use for the below mentioned scenario?

Greetings !!! This is regarding a specific requirement about rsync that we are trying to achieve. We have tried to achieve this by using various rsync options. However, we are encountering different ...
0
votes
0answers
35 views

backing up millions of files and 1 tb [duplicate]

I'm trying to find a fast solution that can transfer about 3 million files taking up about 1tb of space. So far after a bit of research my choices seem to be lftp and rsync. Which option would work ...
0
votes
1answer
34 views

Maintaining rsync log file

I have a cron running rsync for backup purposes, and rsync logs the output to a file via --log-file. This script will keep on running for a quite long time and I am worried that the log file will keep ...
0
votes
3answers
260 views

rsync : write failed - No space left on device (28)

I want to rsync a folder from one server to another. But rsync synchronization fails: $ rsync -zr --compress-level=9 --delete /var/www/mywebsite/current/web/js login@192.168.1.4:/srv/data2_http ...