Rsync is a fast and extraordinarily versatile file copying tool. It can copy locally, to/from another host over any remote shell, or to/from a remote rsync daemon

learn more… | top users | synonyms

0
votes
1answer
21 views

What are the benefits of configuring rsync with rsync shares vs. without?

I know there are two or more methods of working with rsync: The first one requires that rsync would be installed on the destination machine and then you can run something like that: rsync -avz file ...
0
votes
0answers
6 views

What is the recommended backup strategy for GlusterFS?

I have about 1M files in a GlusterFS with rep 2 on 3 nodes. What would be a recommended automated backup strategy for this setup? I already considered the following: 1) glusterfs snapshots in ...
1
vote
1answer
2k views

rsync unexplained error & received SIGINT, SIGTERM, or SIGHUP

I created a batch script to back-up our server: #!/bin/bash user=$1 # create user dir ssh root@local.backup.tst -p 5774 mkdir -p /var/backup/server.tst/incremental/$user # backup mail dir rsync ...
2
votes
2answers
2k views

How safe is rsync --remove-source-files?

I want to move some files using rsync, but it's vital that the files are intact at the destination before removing the source files. The thing is, I can't find any information telling me how rsync ...
2
votes
4answers
2k views

Using Rsync to backup a Windows Share

I have a Windows 7 box that I want to back up to an Ubuntu machine. I have mounted a Windows share on the Ubuntu box (using CIFS/Samba), and I want to use a cron job to rsync what's on the mounted ...
0
votes
1answer
36 views

Ansible synchronize hangs when executing inside ssh with delegate_to

The following task works fine when run directly from my machine. When I run it from a remote machine through SSH it hangs forever. This is the task: - name: deploy public directory ...
0
votes
1answer
13 views

Why is glusterfs renaming files during rsync import?

While searching for an error after failed initial rsync of data to glusterfs I found the following entry in /var/log/glusterfs/data-nfs.log: [MSGID: 109066] [dht-rename.c:1410:dht_rename] ...
1
vote
0answers
22 views

rsync crashes machine while performing sync on glusterfs mounted share

I am running ubuntu 14.04 as guest inside virtualbox 5.0.3 on OS X. While performing rsync on a glusterfs (3.7.x) mounted share with over 100.000 files, the entire machine crashes. There is one ...
-1
votes
0answers
23 views

Is rsync reliable for syncing uploaded files of a LAMP-Application on 2 servers?

We are currently designing the architecture for a High Availability setup of our LAMP application. The last critical question is, how to access the user uploaded images on server 1 from server 2 and ...
0
votes
2answers
24 views

How to transfer data between s3 buckets of the different aws account using command line

How to transfer data between s3 buckets of the different aws account using s3cmd ? command will be like this: s3cmd rsync s3://acc1_bucket/folder/ s3://acc2_bucket/folder --recursive But then how ...
2
votes
1answer
1k views

easy way to restore incremental rsync backup?

I have incremental rsync backups of a folder, created with: rsync --delete -a -v --backup --backup-dir="../backup_`date +%Y-%m-%d`" /orig /backups/dest so I have a copy of current /orig on ...
1
vote
0answers
13 views

Only move folders not existing in target directory [migrated]

I am looking for a way to move folders that are not already present in the target directory on my linux server. Example: Target directory folder1 folder2 folder3 folder4 Source directory folder1 ...
1
vote
2answers
1k views

s3fs Input/output error

I'm trying to set up a backup system with s3fs and the Amazon S3 service. I followed this this guide and this guide. Tailing /var/log/messages I get: Aug 28 13:37:46 server s3fs:###response=403 I ...
0
votes
1answer
1k views

rsync error on Downloading

I am trying to setup a Rsyncmirror on my mount drive /mnt/Mirror/ubuntu_mirror, so I am trying the command: rsync -a --bwlimit=128 rsync://archive.ubuntu.com/ubuntu /mnt/Mirror/ubuntu_mirror but it ...
1
vote
1answer
1k views

How do I get rsync to listen on two different ports via xinetd?

I have multiple servers that receive files via rsync on different ports. I'd like to merge them into the same physical server and let the clients continue to direct their files to the same port they ...
2
votes
1answer
116 views

Cobbler import failing

I've been playing with Cobbler lately (on a CentOS 7 distrib), and I've gone through an error while importing a CentOS 7 iso. I've been able to find a work around to the problem, and I thought it'd be ...
5
votes
2answers
1k views

Using rsync to only delete extraneous files

What's the best way of comparing two directory structures and deleting extraneous files and directories in the target location? I have a small web photo gallery app that I'm developing. Users add ...
2
votes
2answers
30 views

Linux: Detecting/thwarting system modification or use of single user mode

Working through a backup solution and could use some security assistance. Please see below. The process For our editing business, we have an offsite backup server that we update nightly using rsync ...
0
votes
1answer
48 views

Pulling Read restricted files from a remote system with rsync and sudo

A remote system generates statistics files every 5 minutes and places them in a certain directory. At any given time there are 1000+ files in that directory. Every 5 minutes I want to copy the ...
0
votes
0answers
23 views

rsync: Exclude all, include some and exclude sub-dirs

In the past I had a couple of scripts that used rsync to sync a lot of stuff from remote locations to a local HD. I had it setup in the way that, I created a excluded.txt and included.txt file for ...
2
votes
1answer
26 views

passing additional parameters to rsync using rsnapshot

I have my backups being performed by rsnapshot, works well. EXCEPT, on one of the jobs for the /home volume I'd like rsync to copy the sym-links as physical directory/files. I believe the parameter ...
0
votes
1answer
49 views

sporadically, rsync takes exceptionally long

We do backups with rsync like this: rsync -axH --inplace --delete --delete-excluded \ --exclude-from=excludes --stats \ --link-dest="${previous?}" "${source?}"/ "${dest?}"/"${stamp?}" $previous ...
8
votes
4answers
6k views

Encrypted Remote Backups via Rsync?

I run a small modest CentOS server at my house for misc backups, etc. My friend on the other side of town also runs a small modest server at his house for similar purposes. We have been toying with ...
0
votes
1answer
85 views

Rsync shell script permission error on destination server

So this is my first bash script attempt, and I am trying to rsync a project folder on OS X to a development server running ubuntu 14.04. I get some permission errors on the destination server when I ...
1
vote
2answers
24 views

How to prevent rsync from chown'ing remote users files

I'm doing rsync /local/path/to/src user1@remote:/path/to/dest. dest belongs to user2@remote. How do I keep rsync from chown'ing dest to user1 after syncing? Please note that I have already tried ...
0
votes
1answer
34 views

Best way to keep servers in sync without any broken/missing files between syncs

I'm assuming this is the right place to ask this sort of question, but please don't shoot me if I should have gone to a different Stack Exchange. Anyhoo, what would you say the best way to keep ...
1
vote
1answer
39 views

Rsync fails to set the proper uids

I try to rsync a folder from server A to server B: rsync -aAXSHPr --numeric-ids --fake-super --delete --delete-after --delete-excluded -e "ssh -i key" root@1.2.3.4:/home/vmail/ /home/vmail/ rsync ...
0
votes
0answers
6 views

Why isn't ownership preserved with “rsync -a” on my Mac? [migrated]

I am copying files from an internal disk to an external one attached by USB (both are formatted as Mac OS Extended (Journaled)): root# rsync -avi /Volumes/int_hd/ /Volumes/ext_hd/ All directories ...
4
votes
5answers
11k views

rsync --files-from or --include-from

I tried the command: rsync -v --include-from=/path/to/list.lst /home/user /path/to/backup list.lst contains for example .gnupg/ .pki/ .gnome2/keyrings/ ...
2
votes
4answers
2k views

How can I allow the user “postgres” on one server to rsync to another?

I'm trying to get this command to work as the user postgres (so I can ship wal files): rsync -a /tmp/test postgres@server2:/tmp/test But I get the error: Permission denied (publickey). I've run ...
0
votes
0answers
17 views

Solaris run rsync after logadm

I'm trying to get this logadm configuration running. '/dir1/*/*/alert*.log' -C 8 -c -s 10m -t '$file_%Y-%m-%d' -z 0 -a '/usr/bin/rsync -qp /dir1/*/*/alert*.gz ...
0
votes
2answers
26 views

unison or Rsync for session files

In my cheap config I am using 2x app servers and 1x DB server. My question now is what I should use in order to sync session files between the servers for my php app? Is unison or Rsync good here, ...
10
votes
4answers
5k views

Converting UTF-8 NFD filenames to UTF-8 NFC, in either rsync or afpd

I have a home file server running FreeNAS 8. A few days ago I used rsync to upload my entire iTunes library from Mac so that I could load my library over the network instead of off a slow USB drive. ...
3
votes
3answers
3k views

Disable reverse lookup in rsync daemon

I'm having an issue with some rsync modules being served through rsync --daemon This lines are from my /var/log/rsyncd.log file : 2013/02/08 12:15:28 [13174] name lookup failed for XXX.XXX.XXX.XXX: ...
0
votes
0answers
14 views

Can rsync be made to write to the target of a symlink on the destination?

If I'm rsyncing a directory, like this on the source: foo/ (real dir) bar (real file) and on the destination, bar is actually a symlink to <some other file>, like: foo/ (real dir) bar ...
2
votes
4answers
987 views

have rsync handle individual files with single quote in them

I am sync-ing up a directory that has a bunch of documents in it. Users that input documents with all manner of weird characters in their file names. I need to sync up these files from one location ...
0
votes
1answer
49 views

How to rsync to remote machine with user1 for ssh and user2 as remote rsyncer?

UPDATE: it seems I have to use rsync modules. So I created a very simple rsyncd.conf in the home of user2 on the remote server with: [test] path = /dest It does not work, but the problem seems ...
0
votes
1answer
46 views

bash rsync is Killed by signal 2

Problem: I am trying to prevent the user to cancel the script by using ctrl + c. The following script executes completely, except rsync that insists on dying, displaying the error "Killed by signal ...
0
votes
1answer
65 views

Ubuntu 12.04 LUKS/dmcrypt disk to disk copy freezes

I have 2 external USB hard drives encrypted with LUKS in Ubuntu 12.04. Generally, the both drives are very slow with LUKS/dmcrypt, e.g. 7 MB/s for both read/write, but I could live with this. ...
0
votes
3answers
60 views

Multiple servers Rsync into one NAS simultaneaus

Scenario: 1 NAS at our main office (Synology Cubestation CS407) 20 remote servers in various physical retail stores (1 server per store) Network between HQ and stores are in an MPLS/VPN. I have ...
0
votes
2answers
52 views

rsync - How can I exclude from all instances of a file while using relative paths for each file?

I am coding a deployment script that uses rsync to sync cloned repository files with a website target directory. I am trying to allow my users the ability to place a .exclude file anywhere in their ...
1
vote
0answers
64 views

What is a fast, efficient method for threading rsync

I have a single root directory (on a NAS) that I need to backup to another server. The hierarchy of the directory is several layers deep and a majority of the data is composed of extremely large ...
0
votes
0answers
16 views

prevent rsyslog to duplicate logs

my rsyslog writes on secure and on messages i have this *.info;mail.none;authpriv.none;cron.none /var/log/messages authpriv.* ...
13
votes
6answers
15k views

How can one efficiently use S3 to back up files incrementally?

I understand how rsync works on a high-level, but there are 2 sides. With S3 there is no daemon to speak of — well there is, but it's basically just HTTP. There look to be a few approaches. s3rsync ...
2
votes
3answers
85 views

Why is rsnapshot claiming source directory doesn't exist?

I'm trying to set up a backup system using rsnapshot which will copy files from a remote location into a local one. I've got rsnapshot set up, as far as I can see correctly, but when I run rsnapshot ...
-1
votes
1answer
36 views

Rsync, logging the names of files sent

I'm sending files using rsync from server A to B. Server B has limited storage, so once the files are sent, they are copied and deleted. So using rsync's --ignore-existing won't work in this case. I ...
0
votes
2answers
58 views

rsync --update --> warn if local file is newer

We use rsync --update to update files from a server to a laptop. The files on the laptop should not be modified. But the laptop gets used by several people, so a newcomer might think he can change ...
12
votes
5answers
11k views

Execute rsync command over ssh with an ssh agent via crontab

i have a cronjob: 0 9 * * * rsync -a mydir remote_machine: i installed this with 'crontab -e'. i have an ssh-agent running, and when i execute the rsync command itself it works w/o any user ...
1
vote
4answers
51 views

test when directories are in sync using rsync

Is there any way to know from a bash script when a rsync command does not download anything (aka the folder is in sync)?, I've tried using the exit code, but is only different when an error happens. ...
1
vote
0answers
13 views

How can I let rsync display both total and partial progress?

I've found that rsync's total progress is (somewhat) shown with --info=progress2, while partial progress (i.e. the current file) is shown with --info=progress (or -P). Is there a way to show both? ...