Rsync is a fast and extraordinarily versatile file copying tool. It can copy locally, to/from another host over any remote shell, or to/from a remote rsync daemon

learn more… | top users | synonyms

1
vote
2answers
799 views

s3fs Input/output error

I'm trying to set up a backup system with s3fs and the Amazon S3 service. I followed this this guide and this guide. Tailing /var/log/messages I get: Aug 28 13:37:46 server s3fs:###response=403 I ...
0
votes
1answer
41 views

rsync over ssh issue

I RTFMed rsync to the bone, but I just cannot figure out what I'm doing wrong here. I'm trying to sync two folders across SSH. Folders are identical save for one file, as you can see here: ...
1
vote
1answer
16 views

Do different rsnapshot retains use the same hard links?

Say I have a weekly and monthly backup configured in rsnapshot. Will the weekly backups create hard links to the same files created by a previous monthly backup (and vice versa)?
-1
votes
0answers
48 views

How to rsync just the current folder? [migrated]

I want to sync some files from a remote server to my local computer. How can I make rsync to just copy the files with a certain file extension in the directory but no subdirectories? I assumed this ...
13
votes
9answers
9k views

Windows rsync that supports long file names, or an good alternative?

I currently rsync on a Linux host to copy things from Windows to my Linux box. But I can't copy files with long names. I have tried DeltaCopy, cwrsync, and cygwin. From what I have found there all ...
1
vote
1answer
694 views

How do I get rsync to listen on two different ports via xinetd?

I have multiple servers that receive files via rsync on different ports. I'd like to merge them into the same physical server and let the clients continue to direct their files to the same port they ...
2
votes
2answers
842 views

rsync fails with error: Cannot stat destination… cannot allocate memory (12)

I am trying to rsync some directories on my linux server to a Windows 7 share mounted locally on the Linux server at /mnt/backups. My rsync command looks like this: rsync -avz --progress --partial ...
4
votes
3answers
2k views

Converting UTF-8 NFD filenames to UTF-8 NFC, in either rsync or afpd

I have a home file server running FreeNAS 8. A few days ago I used rsync to upload my entire iTunes library from Mac so that I could load my library over the network instead of off a slow USB drive. ...
0
votes
2answers
50 views

rsync IMAP SENT folders between 2 users

How can I handle this: We have a Email system based on DOVECOT IMAP, different users, different logins. I want to somehow rsync all sent folders of some users, so one user can check what another ...
0
votes
2answers
34 views

Can I use rsync to create a list of only changed files?

I am using rsync in a bash script to keep files in sync between a few servers and a NAS. One issue I have run into is trying to generate a list of the files that have changed from the during the ...
0
votes
0answers
1k views

rsync: getcwd(): No such file or directory (2)

I want to sync Server1 and Server2's logs to LogServer. For Server1: rsync -avz -e 'ssh -p 2188' user@server1:/usr/local/servers/logs/* /usr/local/logs/ This one works, but for Server2: rsync ...
3
votes
4answers
752 views

SSH tunnel & Rsync thru two proxy/firewalls

Screnario: [internal_server_1]AA------AB[firewall_1]AC----+ 10.2.0.3-^ ^-10.2.0.2 | internet 10.3.0.3-v ...
-1
votes
1answer
35 views

rsync ESXI 5.5 out of memory in receive_sums [duplicate]

I statically compiled the latest rsync (3.1.1) & can successfully execute the command on my ESXI server. I am getting the following error from rsync however: ERROR: out of memory in receive_sums ...
0
votes
1answer
33 views

Leveraging rsync for a local copy between two slow drives, benefits without a daemon

I am confused by the benefits of rsync (3.1.1) if there is no daemon running remotely, e.g. copying from a drive mounted via SMB2 (via a VPN) to an external HDD (USB 2.0, sadly). Both connections are ...
8
votes
8answers
10k views

How do you synchronise huge sparse files (VM disk images) between machines?

Is there a command, such as rsync, which can synchronise huge, sparse, files from one linux server to another? It is very important that the destination file remains sparse. It may be longer (but ...
0
votes
1answer
36 views

Synchronizing Files between Ubuntu and Windows Server

I have a Ubuntu Server 12.4 LTS with Samba Share and I would like to synchronize my all Folders in the shared folder to the Windows Server (Win2k8R2). So Far I have used Lucky Back up, Freesync and ...
0
votes
1answer
16 views

Rsync Exclude Remote

I try to synchronize content back to a remote server with the difference that server has a new /home/virtual folder what I don't want to touch: rsync -avz --numeric-ids --fake-super --delete ...
-1
votes
2answers
34 views

chown during rsync from windows to unix

rsync: --groupmap=*:www-data: unknown option I am trying to add an option to my rsync line to set the group of the files transfered to have www-data as their group. When i add the option i get ...
-1
votes
1answer
14 views

windows rsync from different local drive, other than c, to remote

rsync -avz D:/test me@my.server.com:/test I am using cwrsync on a windows7 box rsyncing to a linux box. Everything works fine when i am going from a relative path on drive C.. but i need to rsync ...
3
votes
2answers
76 views

BackupPC Taking over 72 hours to backup 250GB's

I am using BackupPC to backup some workstations at the office. One workstations in particular has a sizable amount of data when compared to the rest, however, it's not that large in general (talking ...
17
votes
5answers
19k views

Rsync difference between --checksum and --ignore-times options

Can anyone clarify the differences between the --checksum and --ignore-times options of rsync? My understanding is as follows: --checksum If the file size and time match, it will do a checksum at ...
1
vote
1answer
48 views

How do I properly escape an rsync exclude pattern used in a bash script?

Script: #!/bin/bash site=$1 remote_host=$2 new_site=${3:-$1} cmd="rsync -rlpuvz -e ssh /www/$site/ $remote_host:/www/$new_site --force --delete --exclude=\"site/web_sitemap_*.xml.gz\"" echo $cmd ...
1
vote
0answers
49 views

rsync chgrp Failing on NFS

I am trying to set up NFS on two servers to share files. The owner of the files in question have the same UID and GID on NFS Server and each NFS client. The NFS Server is running on Ubuntu 14.04 and ...
17
votes
9answers
18k views

Best way to compare (diff) a full directory structure?

What's the best way to compare directory structures? I have a backup utility which uses rsync. I want to tell the exact differences (in terms of file sizes and last-changed dates) between the source ...
1
vote
1answer
23 views

Will changed permissions trigger rsync to download again?

I'm running a large rsync job which has been running for hours and will run for a couple more. I need to change permissions on the downloaded files to access them from my web app but I'm worried it ...
2
votes
3answers
99 views

Should I use rsync compression over a gigabit LAN?

I normally use rsync's -z option to enable compression when transferring files over the internet. However, if I am on my own (idle) gigabit LAN, do I still want compression? Or will it be faster ...
14
votes
6answers
15k views

protocol version mismatch — is your shell clean?

When following the instructions to do rsync backups given here: http://troy.jdmz.net/rsync/index.html I get the error "protocol version mismatch -- is your shell clean?" I read somewhere that I ...
1
vote
4answers
105 views

rsync changing already existing files

I have a simple line of rsync in my crontab that gets backup files from the prod server to another. It looks like it is touching the already existing files in the destination folder. This way, the ...
1
vote
2answers
2k views

rsync to EC2 using ssh -i

I'm able to ssh -i mykey.pem to EC2. I'm able to scp -i mykey.pem to EC2. But when I try to rsync -avz -e "ssh -i mykey.pem" I get this error: Warning: Identity file mykey.pem not accessible: No such ...
1
vote
2answers
166 views

rsnapshot: WARNING: Some files and/or directories in / vanished during rsync operation

I once in a while get this message in my rsnapshot log, and an identical message in /var/log/messages. Unfortunately, there is no other deviation from normal output, despite loglevel 5 in ...
2
votes
3answers
499 views

Rsync with ssh-keygen to ssh user with limited commands and specifc directory

I have two machines, local and remote. I want to back up my files and folders to the remote machine automatically, using rsync to transfer files and folders, using ssh-keygen to automatically log ...
0
votes
2answers
94 views

Backup Ubuntu server with cron/rsync: Problems with resuming large files

I currently have a dedicated Ubuntu backup server which wakes itself up from suspend (using rtcwake) daily. 5 minutes later a cron BASH job kicks in, using rsync to pull files from various network ...
15
votes
2answers
641 views

Does Rsync Allow Files To Be Synced Both Ways?

I have backed up a linux web server using rsync with cygwin. I now have a perfect copy of the server on my windows laptop. If i delete or modify a file on my laptop and run rsync again with cygwin ...
1
vote
1answer
52 views

rsync not deleting Folders in destination

I know there are some questings with the same topic here but no answers helped me. First, this is my script. It should copy all files from the source to the destination (preserving all rights, etc). ...
1
vote
1answer
2k views

rsync error unexplained error (code 255) at io.c

I was using a script to perform rsync in sudo crontab. The script does a 2-way rsync (from serverA to serverB and reverse). After i reboot both the server machines, the rsync is not working in sudo ...
1
vote
2answers
3k views

rsync : transferring files in one direction only

Is it possible to use rsync to copy files in one direction only? For example, suppose we have: left/a.txt right/a.txt where the files are initially identical. If one then modifies right/a.txt, ...
1
vote
1answer
113 views

How to sync SVN repository with a remote FTP filesystem

I configured a Centos server locally(in-office) which contains a SVN repository with a project. Many developers are working on this repository and making changes. Also I have a remote server which ...
7
votes
3answers
1k views

Why don't people just use rsync to back up vmware guests?

If I am running a modern vmware ESXi system, I can drop in a statically linked rsync binary and rsync files to any destination over SSH. I'm trying to understand why most (all ?) backup of vmware ...
1
vote
3answers
202 views

Backing up rsnapshot directory with rsync copies entires backup directory

I have a main backup server running rsnapshot, with ~2TB of backups stored on it. After the nightly backups, I copy the contents of the rsnapshot directory to an offsite server, using rsync -aH ...
6
votes
3answers
5k views

Rsync seems incompatible with .bashrc (causes “is your shell clean?”)

It turns out rsync can't work with a remote server which has a .bashrc file? At local client i got when run rsync: protocol version mismatch -- is your shell clean? (see the rsync man page for an ...
1
vote
4answers
558 views

Make cron log rsync only if there was transfer

I have this crontab running every 5 minutes: date >> ~/18/rsync.log rsync -vaz user@r18:~/assets ~/18 >> ~/18/rsync.log 2>&1 It adds this to the log file every 5 minutes: Thu ...
3
votes
1answer
72 views

Can rsync display current average speed?

When I'm transferring large quantities of data using rsync, it would be helpful if I could have the average speed up until now at a glance, rather than a bunch of different speeds for each file.
2
votes
1answer
46 views

rsync from remote ssh server with forwarded keys

Context I am writing a synchronisation script to sync some web environments. Ex: Update integration from production (mostly to fetch new database rows and uploaded files) Some of my prerequisites ...
3
votes
2answers
5k views

How can I prevent vanishing error when using rsync with an nfs mount?

I'm in the process of moving files from an Ubuntu server to a Snow Leopard server. The Ubuntu server has an NFS share of around 6TB which I'd like to clone to the Snow Leopard server. I mounted the ...
5
votes
10answers
14k views

Using Rsync to backup to an external drive

I'm buying an external hard drive to back up the computers in my house (finally!!). I'm hoping to use rsync. I've seen an example that does (or seems to do) exactly what I want. Something like ...
0
votes
2answers
42 views

rsync last 3 days plus weekly backups

I have a shell script that i'll be running with a crontab. Basically I want to modify this so I can do daily backups for the last 3 days. I've seen examples where the last 7 days are backup. I just ...
4
votes
1answer
42 views

Cygwin rsyncd sends too many file names

I have rsyncd running as a Windows service, but when I try to access a module and sync from it, I get the files I want, as well as a lot that I do not — because they are not located in that module on ...
0
votes
2answers
46 views

Apache logging - root user changes groups

I have an issue where I get the following error when trying to download apache logs: rsync: send_files failed to open "/var/log/apache2/log-filename": Permission denied (13) The command I'm running ...
0
votes
2answers
63 views

Is Rsync --link-dest Saving Space

I'm trying to use rsync and "--link-dest=" to create incremental copies of backups on a server (Debian Wheezy, LVM, RAID 1), with the goal of using hard links to save space. Unlike what may be the ...
0
votes
1answer
33 views

copy files to remote server, maintain remote acls

Currently I am using rsync to copy files from local machine to remote. local does not have ACLs while remote does have ACLs. I would like the files that are rsynced across to maintain the ACL's that ...