Rsync is a fast and extraordinarily versatile file copying tool. It can copy locally, to/from another host over any remote shell, or to/from a remote rsync daemon

learn more… | top users | synonyms

0
votes
1answer
47 views

rsync syncs too much files

I have the following directory structure: /tmp1 \_ file1.txt \_ file2.txt /tmp2 \_ file1.txt \_ file2.txt \_ file3.txt /changes With rsync's --compare-dest option, I want to sync all ...
0
votes
2answers
35 views

Sync Apache Root Folder on Two Ubuntu Servers

We currently have two AWS ubuntu instance running two websites on Apache. The instances are behind a load balance. I would like to know what would be the best way to sync the root folder for both ...
0
votes
0answers
5 views

Galera Rsync SST Secured via SSL/SSH

Is it possible to secure Galera Cluster SST via rsync with SSL/SSH? This page suggests it is not, specifically the following quote: Unlike rsync, xtrabackup includes support for SSL encryption ...
1
vote
4answers
77 views

Copying data over with rsync causes size discrepancies

I am switching machines and have attached the old hard drive (/dev/sda4) to the new machine. The old machine had a slightly smaller hard drive (720G), compared to the new one (736G), so I created a ...
0
votes
1answer
13 views

Rsync exclude does not work during remote upload

I prepared an rsync code as below: /home/ra/maindir/subdir/ --exclude="/dir/config" --exclude="/dir/include/x.php" --exclude="/maindir/include/x1.php" What I am trying to do is to exclude 'config' ...
0
votes
0answers
23 views

How to find the bottleneck for slow rsync

I want to find the bottleneck for a slow rsync. I see these parts (on byte flow order): IO on source CPU on source Network CPU on destination IO on destination How can I debug this?
1
vote
1answer
26 views

Rsync --link-dest create folder only when there is something to update

Firstly, I have a hard time understanding what the --update parameter does. I thought that without it, it would logically update any file that changes and I believe that's what it does, so why does ...
1
vote
1answer
71 views

Backing up large files using rsync to external drives (NTFS) taking into consideration performance & speed

Currently files are backed up from one external hard drive to another as a means to provide the ability to restore from a secondary device should the primary external hard drive become unavailable ...
2
votes
2answers
90 views

Faster rsync of huge directory which was not changed

We use rsync to backup servers. Unfortunately the network to some servers is slow. It takes up to five minutes for rsync to detect, that nothing has changed in huge directories. These huge ...
0
votes
1answer
16 views

Rsync: locally cache files to be sent over slow link?

This is regarding the incremental hard-link method of backups, making a daily directory containing a copy of hard links to the original files, and rsync deleting the hardlinks and placing new files ...
-1
votes
1answer
59 views

Can I backup a dovecot account via rsync?

I would like to backup a remote dovecot account to my local disc. The docs explain a tool which seems to support only a "push", not a "pull" way of backup: http://wiki2.dovecot.org/Tools/Doveadm/Sync ...
-4
votes
2answers
30 views

what is wrong with this rsync command? [closed]

Is this syntax wrong for rsync command? The target server is using port 2222 as ssh port but I can't define it right in the rsync command. rsync -dr /home/88/public_html/download/ali -e ssh ssh -p ...
2
votes
0answers
28 views

rsync ionice softraid - limit io locally?

I know this seems to be a recurrent question but it's been troubling for a while now, so if anyone has a brilliant idea please let me know. My Setup OS Debian Wheezy HDDs 2 x 240GB SSD for ...
0
votes
1answer
67 views

rsync maintaining ownership and permissions between linux and windows ssh

I know this is is an extensively documented subject and despite the pages and pages of information ive found on it online I still cant find a definitive answer to this question so please bear with me. ...
2
votes
3answers
319 views

Rsync hangs: expand file_list pointer array to N bytes, did move

Rsync is going into "interruptible sleep" mode after transferring some files from a local folder to a NFS folder. The folder I am trying to backup contains more than 180gb of data. This is what rsync ...
0
votes
1answer
27 views

What's the best way to transfer only new files down from a remote server?

I have a file server that files get dumped on through-out the day. They can be any size, any type, etc. I then want to sync those files down to a remote backup server but the trick is once they're on ...
1
vote
0answers
22 views

Simple progress for rsync when piping output to a log file

I ran rsync with nohup and --progress: nohup rsync --progress --[other-options] source destination & tail -f nohup.out When I'm tailing the file, I see the output with a changing last line ...
0
votes
0answers
28 views

Synchronize files to webserver by lsyncd

I have two webapp, old one is WS1 and the new version is WS2. Now I want to synchronize pictures/attachments from WS1 to WS2 to keep both running. I found some tools like lsyncd / unison / GlusterFS. ...
1
vote
2answers
38 views

rsync files to a kubernetes pod

I need to rsync a file tree to a specific pod in a kubernetes cluster. It seems it should be possible if only one can convince rsync that kubectl acts sort of like rsh. Something like: rsync ...
2
votes
0answers
25 views

How do I prevent rsync failure from breaking my ability to SSH into remote AWS server?

I'm running into this problem where if my rsync to an Amazon CentOS instance breaks mid-transfer (with a Ctrl+C for example), subsequent logins to the server no longer works. The Server just responds ...
5
votes
4answers
212 views

rsync directory so all changes appear atomically

I do some nightly and weekly mirrors of frequently used repositories for the local network. On a few occasions, someone has tried to do an update while the rsync is happening and failed because the ...
0
votes
1answer
24 views

Backup old disk to external disk (new)

One of the 2 x 500GB drives on server is crashed can read but not write the data, which both are on Hardware RAID 0. So I connected an external 1TB new drive to backup the data and replace those 2 x ...
0
votes
0answers
33 views

CENTOS 6.5 x86_64 standard rsync filling cached ram while using nocache

What I'm doing: I have mounted a windows share on my server and every five minutes I move a 1.5GB file to it using this command: nocache -n 4 rsync -a -W --bwlimit=20000 /mnt/share /file/location ...
1
vote
0answers
23 views

Mystic rsync over nfs issue - same error messages but on different files every time

When I try to backup full directories, roughly half of files are copied, other half not. All error messages are all similar - No such file or directory (2) rsync: mkstemp ...
0
votes
2answers
63 views

How to increase the disk write buffer for rsync on Mac OS X?

I have to copy some TB of data from one external drive to another (mostly ~400 MB files). The source is NTFS-formatted USB2 and the best read speed I can get from it is 7MB/s. The target is HFS+ USB3 ...
0
votes
2answers
58 views

Permissions for rsync process to access files it doesn't own withtout running it as root

I want to use rsync to take automated backups from a remote webserver over ssh. The webserver is configured with suphp, so different sites have files with different users and groups. Unfortunately a ...
1
vote
1answer
111 views

Backup with rsync and exclude

I would like to do a partial backup from a server with rsync. my exclude file looks like this bin/ boot/ dev/ initrd.img initrd.img.old lib/ my problem is now, that every lib, bin and so on folder ...
0
votes
1answer
48 views

keep a minimum free space on rsync-destination

I'm using rsync to backup two folders to the same target disk in a nightly cron-job: rsync -avz /very/important/data /Backup/VID/ rsync -avz /other/stuff /Backup/tmp/ The first job backups more ...
0
votes
0answers
36 views

Unison - Monitor and Sync Remote Directories

I have two OpenSuSE 13.2 servers. I want to sync two folders of the same name in the same location on each server. eg: /home/rocket/files/ I'd like to monitor this folder on each server for any ...
-1
votes
1answer
33 views

Two ext4 mounts, fully rsynced, same total file amount, but different total byte size. Why?

Problem We have two mount points on two disks, both are the exact same type. Both disks are formatted ext4. An rsync command with options to synchronize from source to destination is performed. ...
1
vote
1answer
39 views

Backing up Xen Guests from dom0 with disk image file

I have a Xen server dom0 with a number of guests installed and am struggling to find an easy way to manage backups from the dom0 side. Guest scripts: Of course I could run backup scripts on each of ...
0
votes
2answers
73 views

Backup remote database using mysqldump

I am trying to achieve a quick way to do a backup and download a remote mysql database to my local machine, using just the terminal. The remote server uses ssh keys for authentication. I can do it by ...
0
votes
0answers
72 views

Rsync from Ubuntu server to mounted NAS - Input/output error (5)

I am trying to rsync some backup files from a ubuntu server into a mounted NAS. All works well except for a big 13GB gz file which shows this error: rsync: close failed on ...
-1
votes
1answer
53 views

Using rsync with StrictHostKeyChecking and find files older than 5 minutes from remote

I would like to use rsync to sync my files from remote to a local directory. Therefor I use StrictHostKeyChecking so that there's no need to enter a password. Now I would like to only sync files ...
2
votes
3answers
34 views

Is it possible to have orphaned hard links?

I'm not sure if it is even possible to have an orphaned hard link. Let me explain why I'm asking. Bear with me. My Setup I am using rsync to sync my file server to my backup server. I am using the ...
1
vote
3answers
46 views

Rsync size is difference from source to destination

I'm using rsync with the options -r for recursive -l copy symlinks as symlinks -t preserve modification time -D preserve devices and specials -v verbose --prune-empty-dirs The source FS is ext4 and ...
1
vote
1answer
32 views

rsync exclude not working

I have the following rsync exclude that I am trying to run: rsync -av --exclude 'home/dir/public_html/config.text' root@remote. server.com:/home/dir/public_html/ /home/dir/public_html I have ...
3
votes
4answers
354 views

Would rsync be better than tar, wget and untar?

I am migrating to a new server and, as well as html/php files, have a directory which contains around 90,000 files totalling 24GB in size which needs to be moved. When I did a test migration, I used ...
1
vote
1answer
46 views

rsync hanging up reproducable on the same file while copying to nfs share

For the last two days I try to backup my disc to an NFS share. But after a while rsync is hanging up itself. Every time on the same file. But if I exclude the file it'll hangup on the next file. So it ...
1
vote
1answer
98 views

Slow synchronisation stage on gsutil rsync?

I've just started to use GCS as backup for my web servers. One server has 1.2 million JPEGS (3.5TB) and this all rsynced over flawlessly over 10 hours or so. The other has 2.5 million JPEGS (just ...
-2
votes
1answer
31 views

Only downloading new folders/files with rsync

I periodically run a rsync command which downloads new files from my remote server. The files that are downloaded are stored in folders, once I have downloaded them to my local machine I may delete ...
0
votes
3answers
141 views

Rsync with ssh and root not working after change hosts IP

We have a server that backup multiples servers. The backups server is located in the office and all other server in the cloud. We have moved all the server to a new IP, and from this moment the ...
1
vote
1answer
42 views

Backing up remote Ubuntu VPS via rsync — is it possible and reasonable? Any alternatives?

I have a VPS on Digitalocean. They do provide 2 ways of backup (snapshots and "regular backups"), but neither of them can be downloaded from them. My goal is to find a reasonably universal way to ...
1
vote
3answers
33 views

Different free disk space figures in df output after complete rsync -Sap transfer

I did "rsync -Sap --numeric-ids --delete-during /mnt/RAIDVault/ /mnt/RAIDVault-BACKUP/" intending to bring two storage units in sync (having identical content) but ended up with different amount of ...
0
votes
1answer
55 views

Which directories to exclude before full Ubuntu synchronization?

I have two Ubuntu server which I want to synchronize so that I can run the second server when the first server is down. I want to do the synchronization using rsync. But I read, not all the ...
0
votes
0answers
14 views

Rsync daemon : prevent the access of all a subtree except one folder by the rsyncd.conf file?

I got a Linux server on RHEL and i need to synchronize some folders from locals machines on Windows(with cygwin) and on linux via a rsync daemon on the serv. The tree are not set identically on the ...
0
votes
1answer
57 views

Start multiple rsync sessions

I want to start multiple rsync sesssions via screen in detached mode? Is it possible? I need to run rsync script for each file in folder. screen -t -d sshpass -p 123456 rsync5 rsync -avzP ...
0
votes
2answers
42 views

Migrating NFS server (Linux)

We have a NFS server (Linux) who stores files in a iSCSI disk array. This server is in production. The server and the array are very old and have to be replaced soon (the array is already in serious ...
1
vote
2answers
72 views

How to do rsync with different destination port

I'm trying to rsync between two hosts. The source host has SSH keys in the destination server and I verified it can ssh without a password. The destination server is allowing ssh over port 2209. When ...
0
votes
2answers
61 views

Moving files between hosts using intermediate storage area [closed]

Is there any good existing solution for moving files from host A to host C, using host B a an passive intermediate storage area. A -> B -> C Limitations Host A and host C are on separate networks ...