Rsync is a fast and extraordinarily versatile file copying tool. It can copy locally, to/from another host over any remote shell, or to/from a remote rsync daemon

learn more… | top users | synonyms

4
votes
2answers
744 views

synchronizing storage servers

we have a storage server, with currently an amount of about 20TB of media files which we want to synchronize with a second storage server, for backup and fail-over. the facts are: we're storing ...
4
votes
1answer
793 views

rsync / rsnapshot

I am using rsnapshot and my config is as follows: config_version 1.2 snapshot_root /home/user/.snapshots/ cmd_cp /bin/cp cmd_rm /bin/rm cmd_rsync /usr/bin/rsync cmd_ssh /usr/bin/ssh ...
4
votes
2answers
1k views

Multi Thread Rsync Transfer

For some reason when running a single rsync command I am getting 1 MB/sec to 2 MB/sec even when I connecting 2 servers both connected to 1 Gbps ports. rsync -v --progress -e ssh ...
4
votes
2answers
3k views

RSync over SSH - permission denied even though the user is in the root group

I have a need to copy files between servers through the web. I'm using RSYNC over ssh to do so. The problem is, I need to be able to transfer files, no matter where the files is. I created a user ...
4
votes
1answer
1k views

rsync xattr oddness between mac & linux?

Hullo all - I'm using rsync to back up from my mac to a fileserver runnning linux, and I see the following error: rsync -e ssh -vaxE --delete --ignore-errors 192.168.1.3:/bkup/mac/Users/dave/ ...
4
votes
2answers
589 views

rsync not removing single quotes around array of strings --filter list

Trying to safely retrieve files from heavily infected Windows XP and 2003 machines that came to us from an acquisition. I have a similar need for automating a script that would run on PXE booted ...
4
votes
3answers
185 views

Backup Permissions for Entire File System

Here's the skinny: I have a Linode VPS that I want to backup to my local laptop via rsync. I have just generated ssh keys for the communication and left a blank passphrase for the private key so I can ...
4
votes
1answer
278 views

Rsnapshot hard-link ONLY + diffs

We have a 39 TB linux server (mdadm raid 6 15 3TB Drives) that has about 12TB of working data on it. Initially I wanted to create a snapshot system that only saved the data that was changed, much like ...
4
votes
1answer
2k views

Get list of transferred files from rsync?

I'm currently using rsync on a script that deploys a PHP application from a staging to a production server. Here is how: rsync -rzai --progress --stats --ignore-times --checksum /tmp/app_export/ ...
4
votes
1answer
409 views

How can you prevent Permissions Problems when Restoring a Windows Machine with Rsync?

When restoring files (using rsync over cygwin) from Linux to Microsoft Windows XP (and probably to all version of windows), each file restored has permissions so strict, that only the "SYSTEM" account ...
4
votes
1answer
84 views

Cygwin rsyncd sends too many file names

I have rsyncd running as a Windows service, but when I try to access a module and sync from it, I get the files I want, as well as a lot that I do not — because they are not located in that module on ...
4
votes
1answer
164 views

rsync to adapt links that have absolute paths to the location at destination

Would it be possible with rsync to adapt the absolute, symbolic links to a new location at the destination? Test case Imagine I have a link pointing to a file like this: ...
4
votes
2answers
679 views

syncing local folders

What is a best way to keep in sync two local folders ? I know I can use rsync -Ra but I need to keep in sync all the time. Is it possible to make rsync sit in background and constantly sync local ...
4
votes
1answer
466 views

Cygwin's RSYNC for large data transfer

I'm using rsync from Cygwin to do a large scale data transfer from an aging HP MSA 1000 to a new DAS attached to a different server. I have a daemon running on the remote server in read only mode and ...
4
votes
0answers
145 views

Server hacked - want to run an rsync backup in reverse. Will this work? [duplicate]

Possible Duplicate: My server's been hacked EMERGENCY My user account on a shared hosting server got hacked and overwrote every PHP with this at the bottom.... ...
4
votes
3answers
1k views

Have an unprivileged non-account user ssh into another box?

I know how to get a user to ssh into another box with a key: ssh -l targetuser -i path/to/key targethost But what about non-account users like apache? As this user doesn't have a home directory to ...
3
votes
5answers
5k views

SVN Backup using rsync command

I setup a cron for taking backup of my SVN repo( 8 GB) to another server. But some times I get errors and I feel that this is not the proper way to back an svn to a remote server. I used the command ...
3
votes
7answers
7k views

Copying huge files between two remote machines - Efficiently

I have a shell script which keeps on copying huge files (2 GB to 5 GB) between remote systems. Key based authentication is used with agent-forwarding and everything works. For ex: Say the shell script ...
3
votes
3answers
4k views

simple rsync in crontab without password

I would like to run the following: (Centos 5.4) rsync -avz /source_folder 192.168.1.1:/destination_folder right now I'm running it from CLI but eventually I would like to run it from crontab ...
3
votes
2answers
7k views

rsync “Operation not permitted”

I am trying to so a simple rsync to a USB hard disc, the command is rsync -az --modify-window=2 /home /mnt/exthd/tmp/ I am running this as root. but I get a lot of errors that all seem to relate ...
3
votes
5answers
3k views

How do I copy a directory tree but not the files in Linux?

I want to copy about 200 directories & subdirectories from one location to another but I don't want to copy the thousands of files within those directories. I am on Linux. Note: I don't have ...
3
votes
5answers
978 views

Stop rsync from sending confirmation e-mails

Today I found out I have a 25GB /var/mail/root full of e-mails from rsync. Apparently it's sending myself (root@server) an e-mail with the file list every time I run an rsync, which happens to be once ...
3
votes
1answer
3k views

Does rsync delete local files if they were deleted on source folder?

Here's what I'm trying to do: In essence, get files from one net storage device synced to another net storage device. The solution was to rsync from the source net storage to a local machine. Then ...
3
votes
4answers
4k views

Can I rsync from Putty on windows to my Cent OS server?

I'm a bit new to the command line and UNIX but am finding it hugely useful. Is it possible for me to rsync from putty on my windows 7 machine to my virtual server? If not what are my other command ...
3
votes
6answers
618 views

Need to check a directory tree for changes every 10 seconds and run a script if it is changed

I have a directory that has many folders with code inside it, and I need to run a script to rsync changes over to a couple other servers. I have that script written and working fine, but I cannot ...
3
votes
2answers
2k views

rsync with script supplied password

I need to have a script periodically rsync files from a remote host via ssh. The account which the script runs under does not have home directory on the remote host, so I'm not able to store my ...
3
votes
3answers
522 views

What is the best way to copy 9TB of data to multiple external drives, sequentially?

The data is currently stored in a 9TB RAID array, with many users having many files and directories. We'd like to back it up to five 2TB external hard drives, but since we only have one free USB port, ...
3
votes
3answers
2k views

Rsync - maintain 'root' permission on another machine?

I'm just trying to copy a directory from one home server to another, both running Ubuntu (9.04 and 9.10), using rsync. The trouble I'm having is that some of the files in the directory (and ...
3
votes
1answer
306 views

Can rsync display current average speed?

When I'm transferring large quantities of data using rsync, it would be helpful if I could have the average speed up until now at a glance, rather than a bunch of different speeds for each file.
3
votes
3answers
808 views

How to keep multiple servers in sync file wise?

I'm currently managing a cluster of PHP-FPM servers, all of which tend to get out of sync with each other. The application that I'm using on top of the app servers (Magento) allows for admins to ...
3
votes
4answers
1k views

Optimizing RAID 5 for BackupPC use (small random reads)

I am running a BackupPC server with a hardware RAID 5 for the main storage of the backups. Since the machine was created on a tiny budget, the controller is a 3Ware 9500S-4LP for the PCI port and the ...
3
votes
1answer
749 views

Transferring InnoDB database via rsync

We are in the process of switching to a new RAID array and need to copy our MySQL InnoDB database to the new RAID array while minimizing downtime (50GB database). I understand that using rsync on a ...
3
votes
1answer
297 views

Do I need the rsync daemon to take advantage of the differential copying ability of rsync?

This is a fairly simple question. To take advantage of the differential copying ability of rsync, does the receiver HAVE to be running rsync in daemon mode? Or can the sender just connect as necessary ...
3
votes
1answer
1k views

Can't get rsync over sftp to work

I'm trying to set up a backup system from an Ubuntu server to a Synology NAS (DS413j) using rsync and sftp. I have created a user for this that we can call ubuntu-backup. I have a directory in ...
3
votes
2answers
4k views

rsync - failed to set permission - operation not permitted

I got the following command with this error rsync -avz --links -O /home/jansiatest/.jenkins/workspace/svn_to_demo/trunk/CPS/ jansia@ps27670.dreamhost.com:/home/tasklite/temp sending incremental file ...
3
votes
3answers
2k views

using rsync through secure ssh in a cron job

I am trying to set up a shell script under Debian GNU/Linux to backup a directory and subdirectories to a remote NAS running Linux over SSH. This connection has to be encrypted. I have tried a couple ...
3
votes
4answers
957 views

Error in Bash rsync script

A bash script has the following line rsync $OPTS $BACKDIR $USER@$DEST:$DESTDIR but one of the options is rsh='ssh -p2222' It complains : rsync: -p2222': unknown option rsync ...
3
votes
3answers
4k views

Escaping spaces in a remote path when using rsync over a remote SSH connection

When using SSH to connect rsync to a remote server, how do you escape spaces and such in the remote path? A simple backslash escapes the space for the local bash prompt, but on the remote machine the ...
3
votes
2answers
4k views

ssh is ok, but connection refused when trying to rsync, why?

Editing the question, sorry for the confusion I need make cron job that will backup a directory that resides on a remote server, have the backup on the machine running the cron job. The remote server ...
3
votes
2answers
1k views

rsync or sftp?

I am trying to send huge (huge as in approx 5 gb) files between servers .. Which is better, sftp or rsync ? Could someone point me to a comparision of sftp vs rsync if any available ? Is one better ...
3
votes
2answers
1k views

Can rsync do incremental backups if the initial full was done with robocopy?

For example, say I have a full backup done using robocopy. Can I then use rsync to replicate just the changes? Or will rsync do another full copy? I don't want that to happen because it's over a slow ...
3
votes
3answers
190 views

rsync many small files with long filenames takes a lot of bandwidth

I have a file storage server which stores files on disk using the file's sha256 hash as the filename, along with the file extension, and in three levels of directories, e.g. a PDF file with sha256 ...
3
votes
1answer
241 views

How to prevent rsync (using ssh as remote shell) from facing a password prompt

I would like to run rsync without the need to enter a password. I understand I can do this using ssh keys and once the right key has been copied over to the remote server rsync logs in fine without ...
3
votes
3answers
383 views

rsync --link-dest behaviour when run as sudo

In order to create regular backups, I'm using rsync together with --link-dest so as to create hard-links for unchanged files. For example: rsync -ax \ --partial --delete --delete-excluded ...
3
votes
4answers
1k views

Recommendations on managing dot files for users using Puppet

Goal is to have a collection of dot files (.bashrc, .vimrc, etc.) in a central location. Once it's there, Puppet should push out the files to all managed servers. I initially was thinking of giving ...
3
votes
3answers
2k views

Backup strategy for eCryptfs

We have a small network with a Ubuntu server in the middle and Ubuntu notebooks around. The notebooks all use eCryptfs to encrypt the whole home directory of users. Usually, there are two or more ...
3
votes
3answers
6k views

Complex includes/excludes with rsync

I'm trying to work out the rsync filter syntax to perform complex include/excludes, and trying to achieve the following: Include / Exclude /home Include /home/user1/* Include /home/user2/subdir/* ...
3
votes
2answers
3k views

Using rsync to rename files during copying with --files-from?

Using rsync, how can I rename files when copying with the --files-from argument? I have about 190,000 files, each of which need to be renamed when copying from source to destination. I plan to have ...
3
votes
2answers
1k views

Can I use rsync to create a list of only changed files?

I am using rsync in a bash script to keep files in sync between a few servers and a NAS. One issue I have run into is trying to generate a list of the files that have changed from the during the ...
3
votes
2answers
242 views

BackupPC Taking over 72 hours to backup 250GB's

I am using BackupPC to backup some workstations at the office. One workstations in particular has a sizable amount of data when compared to the rest, however, it's not that large in general (talking ...