Rsync is a fast and extraordinarily versatile file copying tool. It can copy locally, to/from another host over any remote shell, or to/from a remote rsync daemon

learn more… | top users | synonyms

4
votes
1answer
446 views

Cygwin's RSYNC for large data transfer

I'm using rsync from Cygwin to do a large scale data transfer from an aging HP MSA 1000 to a new DAS attached to a different server. I have a daemon running on the remote server in read only mode and ...
4
votes
0answers
145 views

Server hacked - want to run an rsync backup in reverse. Will this work? [duplicate]

Possible Duplicate: My server's been hacked EMERGENCY My user account on a shared hosting server got hacked and overwrote every PHP with this at the bottom.... ...
4
votes
3answers
963 views

Have an unprivileged non-account user ssh into another box?

I know how to get a user to ssh into another box with a key: ssh -l targetuser -i path/to/key targethost But what about non-account users like apache? As this user doesn't have a home directory to ...
3
votes
5answers
5k views

SVN Backup using rsync command

I setup a cron for taking backup of my SVN repo( 8 GB) to another server. But some times I get errors and I feel that this is not the proper way to back an svn to a remote server. I used the command ...
3
votes
7answers
3k views

What is the best Linux backup method for a home server? [closed]

I currently back up my Fedora Linux server using rsync and a local USB drive. So far this seems to suit my needs, but I suspect there are better ways to go about this. Long ago I used to use tape, ...
3
votes
7answers
5k views

Copying huge files between two remote machines - Efficiently

I have a shell script which keeps on copying huge files (2 GB to 5 GB) between remote systems. Key based authentication is used with agent-forwarding and everything works. For ex: Say the shell script ...
3
votes
3answers
3k views

simple rsync in crontab without password

I would like to run the following: (Centos 5.4) rsync -avz /source_folder 192.168.1.1:/destination_folder right now I'm running it from CLI but eventually I would like to run it from crontab ...
3
votes
10answers
3k views

Best online backup provider with simple and secure FTP server [closed]

I'm looking to do online backups of some data from a Linux server. The amount of data is pretty small right now and it's unlikely to ever exceed 10 GB or so. I've already got a cron job set up that ...
3
votes
2answers
6k views

rsync “Operation not permitted”

I am trying to so a simple rsync to a USB hard disc, the command is rsync -az --modify-window=2 /home /mnt/exthd/tmp/ I am running this as root. but I get a lot of errors that all seem to relate ...
3
votes
5answers
789 views

Stop rsync from sending confirmation e-mails

Today I found out I have a 25GB /var/mail/root full of e-mails from rsync. Apparently it's sending myself (root@server) an e-mail with the file list every time I run an rsync, which happens to be once ...
3
votes
1answer
2k views

Does rsync delete local files if they were deleted on source folder?

Here's what I'm trying to do: In essence, get files from one net storage device synced to another net storage device. The solution was to rsync from the source net storage to a local machine. Then ...
3
votes
3answers
2k views

Converting UTF-8 NFD filenames to UTF-8 NFC, in either rsync or afpd

I have a home file server running FreeNAS 8. A few days ago I used rsync to upload my entire iTunes library from Mac so that I could load my library over the network instead of off a slow USB drive. ...
3
votes
4answers
3k views

Can I rsync from Putty on windows to my Cent OS server?

I'm a bit new to the command line and UNIX but am finding it hugely useful. Is it possible for me to rsync from putty on my windows 7 machine to my virtual server? If not what are my other command ...
3
votes
3answers
5k views

run rsync as root but keep user ownership

I would like to backup user files from one server to another with rsync. but I noticed that the user folders change to root. how can I keep the user permissions with rsync (running by root)?
3
votes
6answers
589 views

Need to check a directory tree for changes every 10 seconds and run a script if it is changed

I have a directory that has many folders with code inside it, and I need to run a script to rsync changes over to a couple other servers. I have that script written and working fine, but I cannot ...
3
votes
2answers
1k views

rsync with script supplied password

I need to have a script periodically rsync files from a remote host via ssh. The account which the script runs under does not have home directory on the remote host, so I'm not able to store my ...
3
votes
3answers
455 views

What is the best way to copy 9TB of data to multiple external drives, sequentially?

The data is currently stored in a 9TB RAID array, with many users having many files and directories. We'd like to back it up to five 2TB external hard drives, but since we only have one free USB port, ...
3
votes
1answer
60 views

Can rsync display current average speed?

When I'm transferring large quantities of data using rsync, it would be helpful if I could have the average speed up until now at a glance, rather than a bunch of different speeds for each file.
3
votes
3answers
580 views

How to keep multiple servers in sync file wise?

I'm currently managing a cluster of PHP-FPM servers, all of which tend to get out of sync with each other. The application that I'm using on top of the app servers (Magento) allows for admins to ...
3
votes
2answers
1k views

rsync with --hard-links freezes

I have a large directory called servers, which contains many hard-links made by rsnapshot. That means that the structure is more or less like: ./servers ./servers/daily.0 ./servers/daily.0/file1 ...
3
votes
1answer
556 views

Transferring InnoDB database via rsync

We are in the process of switching to a new RAID array and need to copy our MySQL InnoDB database to the new RAID array while minimizing downtime (50GB database). I understand that using rsync on a ...
3
votes
1answer
293 views

Do I need the rsync daemon to take advantage of the differential copying ability of rsync?

This is a fairly simple question. To take advantage of the differential copying ability of rsync, does the receiver HAVE to be running rsync in daemon mode? Or can the sender just connect as necessary ...
3
votes
1answer
480 views

Why does rsync have to be installed on both sides to work?

This might be a silly question, but I wanted to keep some of my servers clean and prefer not to install any additional software. But I always thought rsync would copy data over SSH and would not ...
3
votes
3answers
1k views

using rsync through secure ssh in a cron job

I am trying to set up a shell script under Debian GNU/Linux to backup a directory and subdirectories to a remote NAS running Linux over SSH. This connection has to be encrypted. I have tried a couple ...
3
votes
2answers
942 views

What is the default remote shell for rsync?

Just curious, what is the default remote shell used by rsync when you're not using it in daemon mode? According to the man page it can be run via rsh or ssh. However nowhere in the man page does it ...
3
votes
4answers
821 views

Error in Bash rsync script

A bash script has the following line rsync $OPTS $BACKDIR $USER@$DEST:$DESTDIR but one of the options is rsh='ssh -p2222' It complains : rsync: -p2222': unknown option rsync ...
3
votes
2answers
1k views

Can rsync do incremental backups if the initial full was done with robocopy?

For example, say I have a full backup done using robocopy. Can I then use rsync to replicate just the changes? Or will rsync do another full copy? I don't want that to happen because it's over a slow ...
3
votes
1answer
177 views

How to prevent rsync (using ssh as remote shell) from facing a password prompt

I would like to run rsync without the need to enter a password. I understand I can do this using ssh keys and once the right key has been copied over to the remote server rsync logs in fine without ...
3
votes
2answers
3k views

rsync - failed to set permission - operation not permitted

I got the following command with this error rsync -avz --links -O /home/jansiatest/.jenkins/workspace/svn_to_demo/trunk/CPS/ jansia@ps27670.dreamhost.com:/home/tasklite/temp sending incremental file ...
3
votes
3answers
299 views

rsync --link-dest behaviour when run as sudo

In order to create regular backups, I'm using rsync together with --link-dest so as to create hard-links for unchanged files. For example: rsync -ax \ --partial --delete --delete-excluded ...
3
votes
4answers
1k views

Recommendations on managing dot files for users using Puppet

Goal is to have a collection of dot files (.bashrc, .vimrc, etc.) in a central location. Once it's there, Puppet should push out the files to all managed servers. I initially was thinking of giving ...
3
votes
3answers
3k views

Escaping spaces in a remote path when using rsync over a remote SSH connection

When using SSH to connect rsync to a remote server, how do you escape spaces and such in the remote path? A simple backslash escapes the space for the local bash prompt, but on the remote machine the ...
3
votes
2answers
5k views

How can I prevent vanishing error when using rsync with an nfs mount?

I'm in the process of moving files from an Ubuntu server to a Snow Leopard server. The Ubuntu server has an NFS share of around 6TB which I'd like to clone to the Snow Leopard server. I mounted the ...
3
votes
3answers
2k views

Backup strategy for eCryptfs

We have a small network with a Ubuntu server in the middle and Ubuntu notebooks around. The notebooks all use eCryptfs to encrypt the whole home directory of users. Usually, there are two or more ...
3
votes
3answers
5k views

Complex includes/excludes with rsync

I'm trying to work out the rsync filter syntax to perform complex include/excludes, and trying to achieve the following: Include / Exclude /home Include /home/user1/* Include /home/user2/subdir/* ...
3
votes
2answers
3k views

Using rsync to rename files during copying with --files-from?

Using rsync, how can I rename files when copying with the --files-from argument? I have about 190,000 files, each of which need to be renamed when copying from source to destination. I plan to have ...
3
votes
1answer
277 views

rsync connection closing right around an hour

I am running some command in cron that does an rsync over two data centers. The connection rate between the data centers is around 1Mbps. I noticed that rsync keeps failing around 2.7GB to 2.9GB of ...
3
votes
2answers
1k views

Disable reverse lookup in rsync daemon

I'm having an issue with some rsync modules being served through rsync --daemon This lines are from my /var/log/rsyncd.log file : 2013/02/08 12:15:28 [13174] name lookup failed for XXX.XXX.XXX.XXX: ...
3
votes
1answer
619 views

Why does rsync forks itself? And why one such forked process is almost kinda idle (as seen in iotop)?

This is referring to the matter stated here and I am also experiencing the same. In one of my servers, I ran an rsync, to backup a huge directory (size greater than 300 Gb) to a different disk, ...
3
votes
3answers
653 views

rsync filter file rules for subpath

I have a big problem in understanding rsync filter rules for sub path. I have this directory tree: |-- index.php |-- other-file-php.php |-- filesource.php | |-- album1 | | |-- firstphoto.jpg | ...
3
votes
1answer
211 views

rsync flagging files that are the same exact for timestamp

When I do rsync --dry-run -rv, rsync is listing files that are identical except for their timestamps. My understanding was that with just these flags (which don't really change the comparison ...
3
votes
1answer
231 views

Rsync: General file/folder synchronization

I have a file server, which is in-charge of pulling a folder tree from multiple workstations on a daily basis. My current method for this is by using rsync, (which works pretty well provided directory ...
3
votes
2answers
899 views

Git-style incremental backup with rsync

I'm trying to setup a backup script on Ubuntu. Every day I want to copy my local source directory to a backup directory on a remote server uniquely named with the date. (e.g., backup-jan1/, ...
3
votes
6answers
940 views

Transfer a file from remote server A to remote server B from server C

I have an interesting problem I'm trying to solve. I have a JumpBox server that I have in order to securely ssh into client's servers. This is the only server my clients ever open up port 22 to. ...
3
votes
3answers
664 views

Daily incremental backup + weekly full backup

I have a server with CentOS 5.6, with SVN on it and I would like to take incremental backups of the changes on a daily basis while I take a full backup on a weekly basis. I need to back this up on an ...
3
votes
2answers
571 views

Key authentication not working when using ssh or rsync as sudo

I have ssh RSA key authentication setup between a client and an ubuntu server (following this procedure): -the RSA key authentication for ssh and rsync work fine (no need for password). -the RSA key ...
3
votes
3answers
2k views

Rsync failing when trying to run via cron

I am trying to set up a cron to run this command: rsync -e "ssh -i /home/ldsmp3/ssh-key -o GSSAPIAuthentication=no" -az /home/ldsmp3/public_html ...
3
votes
3answers
774 views

Immutable hard links on ext3/4?

In my research on file versioning at the fs level, snapshotting, and related ideas, I took a look at hard-links and exactly what they are and how they behave. Using rsync you can get a pretty slick ...
3
votes
1answer
128 views

How to backup OS-specific files with rsync? (Mac OS X to Ubuntu Server)

I want to setup an automatic backup system using rsync to backup documents/source code from Mac OS X to Ubuntu Server. I have some documents written in Pages (iWork), and lastly when I tried to ...
3
votes
2answers
389 views

rsync - How to exclude one .htaccess but not all of them

I have an rsync command for copying my files from dev to production. I don't want to copy the .htaccess file that's in the root of the HTML directory but, I do want to copy the few .htaccess files ...