Rsync is a fast and extraordinarily versatile file copying tool. It can copy locally, to/from another host over any remote shell, or to/from a remote rsync daemon

learn more… | top users | synonyms

1
vote
1answer
124 views

Transfer 40000+ files usnig rsync between two servers

I have a problem with transfer files between two Linux servers in the same network. On source server I have directory with 40055 small files, directory size is 34 GB. I tried to transfer those files ...
0
votes
2answers
200 views

Graceful way to rsync millions of files between two local folders

I want to rsync a folder with millions of files from a local directory to another, on a daily basis. The files themselves change very rarely. I want to reduce the impact on the running server, e.g. ...
5
votes
3answers
4k views

rsync 'cannot delete non-empty directory' errors, even with --force option

When running this command: $ sudo rsync -r --delete --force --checksum --exclude=uploads /data/prep/* /data/app/ I'm getting the following output: cannot delete non-empty directory: ...
0
votes
1answer
89 views

rsync works one way but not the other

I have a problem with using rsync. When I try to copy a remote file I get the following error: [home ~]$ rsync test.txt qnx: sh: rsync: cannot execute - No such file or directory rsync: connection ...
0
votes
1answer
94 views

rsync doesnt copy all files and folders

I have been scratching my head about this issue now for a few days and some serious googling hasn't uncovered the solution. Basically I am making a full copy of my server, in order to migrate hosts. ...
0
votes
3answers
2k views

Cant understand Rsync errors using ssh

I want to tryout Rsync for the first time but have run into difficulty. I want to transfer files from a remote server to my local server. I login to my local server and type: sudo rsync -avz ssh ...
5
votes
2answers
6k views

How to fix corrupt packet error for with rsync for (relatively) large files?

Trying to update files on a server, with the rsync command: rsync -ravq -e "ssh -o ConnectTimeout=2 -o ServerAliveInterval=2 -ServerAliveCountMax=2" --delete ./local_dir user@$SERVER:/dest_dir ...
1
vote
1answer
182 views

How can I use a remote admin tool (puppet or chef) combined with a sync tool (e.g. rsync) to send log files from several servers to a central server?

Summary How can I use a remote admin tool (puppet or chef) combined with a sync tool (e.g. rsync) and scheduler (cron) to send log files from several servers to a central server? Context Our ...
0
votes
1answer
2k views

rsync permission fail cannot open directory

i encounter a problem when troubleshooting rsync server and client. rsync: opendir "/." (in pub) failed: Permission denied (13) drwxr-xr-x 4096 2014/01/27 12:02:24 . rsync error: some ...
1
vote
2answers
128 views

How to let rsnapshot continue after backup error?

I have implemented a multi-server backup system, which is working quite effectively. I have a backup server with a large disk-array, and every night it runs rsnapshot to backup relevant data on all ...
0
votes
1answer
78 views

rsync, dd and then add to RAID 1, could cause database corrupted?

Firstly I have a HDD which has been setup as RAID, type Volume, not RAID 0 or RAID 1 ... and I wanna add one more HDD to setup a RAID 1 array. These bellow steps are what I've done. Detach from ...
0
votes
0answers
55 views

Ubuntu backup script kills performance

I run a nightly backup, which takes about 1 hour. During that the performance is bad as hell. It looks pretty much like this: # DB dump ionice -c 3 nice -n 20 mysqldump --skip-lock-tables --user=foo ...
3
votes
2answers
333 views

rsync over active ssh connection

Trying to script as clean as possible, I wonder if there is some solution for the following situation: One Linux server running sshd and one android device, with dropbear ssh client and rsync ...
-2
votes
1answer
101 views

Rsync and ssh script

I really dont need ssh keys. The server has good security implemented. I need the script to input the password without user usage/interaction. How can I make this? Its CentOS release 6.5 (Final) ...
1
vote
1answer
740 views

Synology NAS - rsync messing up versioning / deduplication

Is it true that Synology DSM 4.3's default rsync implementation is not able to handle "vast" amounts of data and could mess up versioning / deduplication? Could it be that any of the variables (see ...
1
vote
3answers
8k views

Rsync command issues, owner and group permissions doesn´t change

I´m trying to set owner and group via rsync and it doesn't seem to be working. This is the command: sudo rsync -rlptDvz --owner=cmsseren --group=cmsseren /home/serena/public_html/ -e ssh ...
1
vote
2answers
2k views

Ubuntu rsync to synology: IP denied

I am trying to sync my (new) Ubuntu webserver directory to my Synology NAS. Network backup is enabled, when I do a dry run: rsync --dry-run . rsync://root@192.168.1.150 It shows the available ...
0
votes
1answer
65 views

File system for rsyncing to loop mounted file?

As a backup, I want to rsync a system partition to a loop mounted file (which is stored in Dropbox). The size of the partition is ca. 2GB and growing, and the backup is scheduled to happen once per ...
1
vote
1answer
807 views

Configure SElinux to allow rsync from a remote machine

I've set up a Debian machine with SElinux and except rsync from a remote machine everything works fine. I already created some module with additional rights using audit2allow, and now all errors in ...
1
vote
0answers
557 views

Backup archive format for delta syncing to Dropbox?

On an Amazon EC2 server with Linux AMI, I currently have a daily backup cron job be run: TMP_BACKUP_FILE="/tmp/backup.tar" BACKUP_FILE="/home/ec2-user/Dropbox/Backup/backup.tar" rm -f ...
2
votes
3answers
569 views

Should I use ec2 as a file server?

I need to be able to share user uploaded content across multiple EC2 application servers. I have looked at rsync, mounted NFS, and S3 as potential options of being able to share this data in almost ...
1
vote
1answer
71 views

How to avoid mirroring remote directory parents with rsync?

I am running this command: rsync -zavrR --delete --links --stats --rsh="ssh -p 2222 -l user" www.example.com:/home/user/public_html/ /home/user/public_html/rsynctest Current behavior is that I get ...
2
votes
1answer
280 views

Keep unread flags during a cyrus mail migration with rsync

I use rsync to migrate the mails beetween my cyrus 2.3.14 server (source) and 2.3.16 cyrus server (target). However I have a little problem. On the source cyrus server, the mails were stored in ...
1
vote
0answers
74 views

Weird permissions getting set on directories after rsync

I've got a drive on a Mac (OSX 10.7.5) that I'm sharing on the LAN. In the system preferences, the share is set so System Administrator has Read & Write access, System Group has Read Only, and ...
0
votes
3answers
490 views

inotify and rsync on large number of files

I am using inotify to watch a directory and sync files between servers using rsync. Syncing works perfectly, and memory usage is mostly not an issue. However, recently a large number of files were ...
0
votes
1answer
64 views

RSYNC only Updated Files

I am running the following script to push information off of a remote server and store it on a local server. The script works but every time it is ran it downloads everything over again. I have tried ...
1
vote
1answer
235 views

rsync freebsd client, rsync linux server

Many hours to check this script but nothing of good... I've a linux rsync server and with linux client I use: rsync --password-file=/usr/home/user/.rsync.pass --log-file=/var/log/docs.log --progress ...
0
votes
1answer
207 views

Previously-working rsync operation failling in recent Windows 8.1 update showing “error in socket io”

I have been running rsync and rsyncd on my Windows boxes for years and only recently have I had an issue. Apparently, when my Linux and FreeBSD boxes try to sync their data with what's on the Windows ...
1
vote
1answer
93 views

building file list database with rsync

Folks, Please correct me if I am wrong, but I was under the assumption that the reason rsync's first run is slower than subsequent, is because it builds up a database of the file structure on the ...
-1
votes
1answer
324 views

Rotating Backups with RSync and CP - Excludes not working perfectly

My script looks essentially like this: cp -al $yesterdays_snapshot $todays_snapshot rsync -vadlH --exclude-from excludes.rsyc $source $todays_snapshot This works great except for one problem: If ...
2
votes
1answer
63 views

rsync stop before filesystem full

I would like to implement a rsync that should stop if the destination filesystem free space goes down to less than 10G and I wonder what is the best way to do so? I'm running on Linux RedHat 5.2 A ...
1
vote
1answer
100 views

Backup Subversion Repositories with rsync [duplicate]

Is it ok to Synchronize the SVN Repository directory using the rsync command. Will there be any issues, will the repository files get corrupted due to this? (I use rsync only when no one is using the ...
0
votes
3answers
1k views

Sync directory across two servers using rsync (or alternative for syncing directories)

I have two VMs that should have identical files in this directory: /var/www/owncloud/data/admin/files/ I initially thought that I could use rsync with cron to copy the files every two minutes: On ...
-1
votes
1answer
76 views

Rsync backup - detect new directory and backup only from that directory

New cpanel daily backup is creating separate directories for daily backup. This creates problem when I try to user rsync to do an offsite backup since I would like to rsync only latest data. E.g. On ...
-5
votes
1answer
55 views

Backup of images [closed]

I've just installed a Ubuntu for a file server. It will share a folder (samba) and employees of my company will save photos on that. Currently the total amount of the photos is about 100GB and every ...
0
votes
2answers
520 views

why rsync is not working with crontab?

when I run the following manually it runs perfectly: /usr/bin/rsync -arvth -e "ssh -i /watch/scripts/word.pem" 1.1.1.1:/opt/ /opt when it runs using crontab. I get: Permission denied ...
0
votes
1answer
119 views

rsync around a VPN connection on CentOS 6.4

I'm trying to rsync outside of a VPN connection. I have a CentOS 6.4 machine that has an open VPN connection, that capable of roughly 10Mbps, whereas the WAN connection is 40Mbps. I'm trying to rsync ...
0
votes
6answers
396 views

Load balancing with rsync

i have 2 server with public ip: SERVER A - 10.10.10.11 SERVER B - 10.10.10.12 both of them are centos 6 in OS, installed nginx with php-fpm, 2 exact same website stored at: /var/www/html. Domain ...
1
vote
0answers
222 views

How do I make rsync also check ctime?

rsync detects files modification by comparing size and mtime. However, if for any reason, the mtime is unchanged, rsync won't detect the change, although it's possible to spot it by looking at the ...
-4
votes
3answers
1k views

rsync over ssh to esxi

I try to backup esxi via rsync over ssh. I run rsyc but I get error: # rsync -e ssh -av root@ip.esxi:file.txt . sh: rsync: not found rsync: connection unexpectedly closed (0 bytes received so far) ...
0
votes
2answers
340 views

What is the best way to transfer large amount of small files from 1 Windows Server to another over the internet? [closed]

I'm trying to one way sync around 100,000 small files for a total of 2GB from a server located in my office to a web server. I'm using Syncrify with some success but the scheduling feature does not ...
1
vote
2answers
1k views

mounting windows shares on linux while keeping windows permissions

I have a windows share on a windows2003 server (WINJOE) which I want to back up to a Linux machine (LINUXJOE) that is properly joined to the domain. My goal is to backup shared folders of WINJOE to ...
3
votes
1answer
2k views

Can't get rsync over sftp to work

I'm trying to set up a backup system from an Ubuntu server to a Synology NAS (DS413j) using rsync and sftp. I have created a user for this that we can call ubuntu-backup. I have a directory in ...
9
votes
1answer
2k views

Why does rsync spawn multiple processes for me?

I am using the following cron statement to backup from one folder to another folder in the same machine: 19 21 * * * root rsync -ac --delete /source/folder /dest/folder When I use pstree, I see ...
-1
votes
1answer
406 views

Run totally silent rsync?

I have a cronjob that runs hourly, and is totally silent unless something goes wrong. Well ... almost ... A part of the job is rsync --del -Cacqrz public/. user@host.example.com:/target/path This ...
0
votes
1answer
205 views

Is there a way to synchronize my distributed storage infrastructure with file changes possible on each location? [closed]

I need a storage device in 3 different location. Each device will have 4TB of storage. At least 2TB should be a 'shared folder' working like Dropbox: when a user change a file in one location, the ...
0
votes
2answers
93 views

Rsync for generating daily backups, with some sort of history

this is probably expanding on Using Rsync to backup to an external drive I usually, manually, back up my data to an external drive. I start by creating a directory on the external drive with today's ...
0
votes
3answers
170 views

How to use `rsync` to securely push to a mirror?

I am using rsync --rsh "ssh" to push to a mirror. Setting the necessary file system permissions on the mirror requires rsync to run with root privileges on the mirror. However, the mirrored files ...
1
vote
1answer
128 views

Rsync - Recursively Include Few of Many Folders in One Statement

For the sake of this post, lets assume I have a folder called "misc" that has 100 sub-folder named 001 to 100. Each folder has many sub-folders and files. I want to write one rsync command that ...
0
votes
1answer
399 views

Copy Files/Folders on Windows Volumes Created from Mac

We are trying to migrate storage from one volume to another, and we are running into problems with folders and files created from Mac OSX. The current file storage is on windows, and unfortunately ...