Rsync is a fast and extraordinarily versatile file copying tool. It can copy locally, to/from another host over any remote shell, or to/from a remote rsync daemon

learn more… | top users | synonyms

1
vote
1answer
46 views

rsync hanging up reproducable on the same file while copying to nfs share

For the last two days I try to backup my disc to an NFS share. But after a while rsync is hanging up itself. Every time on the same file. But if I exclude the file it'll hangup on the next file. So it ...
12
votes
3answers
14k views

rsync won't delete files on destination

I am trying to mirror a directory that changes over time to another directory. My problem is that rsync is not deleting files on destination if they aren't existing in source directory anymore. Here ...
0
votes
1answer
47 views

rsync syncs too much files

I have the following directory structure: /tmp1 \_ file1.txt \_ file2.txt /tmp2 \_ file1.txt \_ file2.txt \_ file3.txt /changes With rsync's --compare-dest option, I want to sync all ...
0
votes
2answers
35 views

Sync Apache Root Folder on Two Ubuntu Servers

We currently have two AWS ubuntu instance running two websites on Apache. The instances are behind a load balance. I would like to know what would be the best way to sync the root folder for both ...
0
votes
0answers
5 views

Galera Rsync SST Secured via SSL/SSH

Is it possible to secure Galera Cluster SST via rsync with SSL/SSH? This page suggests it is not, specifically the following quote: Unlike rsync, xtrabackup includes support for SSL encryption ...
0
votes
1answer
2k views

rsync error on Downloading

I am trying to setup a Rsyncmirror on my mount drive /mnt/Mirror/ubuntu_mirror, so I am trying the command: rsync -a --bwlimit=128 rsync://archive.ubuntu.com/ubuntu /mnt/Mirror/ubuntu_mirror but it ...
1
vote
2answers
1k views

s3fs Input/output error

I'm trying to set up a backup system with s3fs and the Amazon S3 service. I followed this this guide and this guide. Tailing /var/log/messages I get: Aug 28 13:37:46 server s3fs:###response=403 I ...
2
votes
1answer
1k views

easy way to restore incremental rsync backup?

I have incremental rsync backups of a folder, created with: rsync --delete -a -v --backup --backup-dir="../backup_`date +%Y-%m-%d`" /orig /backups/dest so I have a copy of current /orig on ...
2
votes
2answers
1k views

How to make sshfs + VPN + git a tolerable working environment?

Currently the code base for the project I am working on is remotely on a company server. and it has to stay like that. also the remote git repository cannot be made public. My current setup is: ...
39
votes
2answers
17k views

How to keep the full path with rsync?

When backing up with rsync, How do I keep the full directory structure? For example, the remote server is saturn, and I want to backup saturn's /home/udi/files/pictures to a local directory named ...
1
vote
4answers
77 views

Copying data over with rsync causes size discrepancies

I am switching machines and have attached the old hard drive (/dev/sda4) to the new machine. The old machine had a slightly smaller hard drive (720G), compared to the new one (736G), so I created a ...
1
vote
0answers
102 views

rsync crashes machine while performing sync on glusterfs mounted share

I am running ubuntu 14.04 as guest inside virtualbox 5.0.3 on OS X. While performing rsync on a glusterfs (3.7.x) mounted share with over 100.000 files, the entire machine crashes. There is one ...
5
votes
4answers
212 views

rsync directory so all changes appear atomically

I do some nightly and weekly mirrors of frequently used repositories for the local network. On a few occasions, someone has tried to do an update while the rsync is happening and failed because the ...
2
votes
1answer
3k views

rsync unexplained error & received SIGINT, SIGTERM, or SIGHUP

I created a batch script to back-up our server: #!/bin/bash user=$1 # create user dir ssh root@local.backup.tst -p 5774 mkdir -p /var/backup/server.tst/incremental/$user # backup mail dir rsync ...
6
votes
4answers
2k views

rsync - report only uploaded files

I have a problem with rsync: either it shows me all files in the directories I am rsyncing (if using the flag -v) or nothing at all (when not using -v). I would like to have rsync quiet except for ...
0
votes
1answer
4k views

rsync: getcwd(): No such file or directory (2)

I want to sync Server1 and Server2's logs to LogServer. For Server1: rsync -avz -e 'ssh -p 2188' user@server1:/usr/local/servers/logs/* /usr/local/logs/ This one works, but for Server2: rsync ...
2
votes
3answers
323 views

Rsync hangs: expand file_list pointer array to N bytes, did move

Rsync is going into "interruptible sleep" mode after transferring some files from a local folder to a NFS folder. The folder I am trying to backup contains more than 180gb of data. This is what rsync ...
0
votes
1answer
13 views

Rsync exclude does not work during remote upload

I prepared an rsync code as below: /home/ra/maindir/subdir/ --exclude="/dir/config" --exclude="/dir/include/x.php" --exclude="/maindir/include/x1.php" What I am trying to do is to exclude 'config' ...
0
votes
0answers
23 views

How to find the bottleneck for slow rsync

I want to find the bottleneck for a slow rsync. I see these parts (on byte flow order): IO on source CPU on source Network CPU on destination IO on destination How can I debug this?
20
votes
7answers
19k views

How can one efficiently use S3 to back up files incrementally?

I understand how rsync works on a high-level, but there are 2 sides. With S3 there is no daemon to speak of — well there is, but it's basically just HTTP. There look to be a few approaches. s3rsync ...
1
vote
1answer
71 views

Backing up large files using rsync to external drives (NTFS) taking into consideration performance & speed

Currently files are backed up from one external hard drive to another as a means to provide the ability to restore from a secondary device should the primary external hard drive become unavailable ...
1
vote
1answer
26 views

Rsync --link-dest create folder only when there is something to update

Firstly, I have a hard time understanding what the --update parameter does. I thought that without it, it would logically update any file that changes and I believe that's what it does, so why does ...
2
votes
2answers
91 views

Faster rsync of huge directory which was not changed

We use rsync to backup servers. Unfortunately the network to some servers is slow. It takes up to five minutes for rsync to detect, that nothing has changed in huge directories. These huge ...
10
votes
2answers
2k views

How do I use rsync with an IPv6 address via SSH?

I've been having difficulty with connecting to my IPv6 address via rsync. Because the argument for the destination folder is colon-separated, the IPv6 address disrupts this like so: ...
5
votes
3answers
7k views

How to set file/folder permissions using Rsync from Windows to Linux

I want to transfer lots of files/folders from Windows to Linux using Rsync. On linux server(destination), I want the file permission set to 644, and folder permission set to 755. If possible, I want ...
2
votes
4answers
5k views

Should I use rsync compression over a gigabit LAN?

I normally use rsync's -z option to enable compression when transferring files over the internet. However, if I am on my own (idle) gigabit LAN, do I still want compression? Or will it be faster ...
1
vote
2answers
38 views

rsync files to a kubernetes pod

I need to rsync a file tree to a specific pod in a kubernetes cluster. It seems it should be possible if only one can convince rsync that kubectl acts sort of like rsh. Something like: rsync ...
121
votes
13answers
134k views

Copying a large directory tree locally? cp or rsync?

I have to copy a large directory tree, about 1.8 TB. It's all local. Out of habit I'd use rsync, however I wonder if there's much point, and if I should rather use cp. I'm worried about permissions ...
0
votes
1answer
16 views

Rsync: locally cache files to be sent over slow link?

This is regarding the incremental hard-link method of backups, making a daily directory containing a copy of hard links to the original files, and rsync deleting the hardlinks and placing new files ...
1
vote
2answers
6k views

rsync error unexplained error (code 255) at io.c

I was using a script to perform rsync in sudo crontab. The script does a 2-way rsync (from serverA to serverB and reverse). After i reboot both the server machines, the rsync is not working in sudo ...
-1
votes
1answer
60 views

Can I backup a dovecot account via rsync?

I would like to backup a remote dovecot account to my local disc. The docs explain a tool which seems to support only a "push", not a "pull" way of backup: http://wiki2.dovecot.org/Tools/Doveadm/Sync ...
0
votes
3answers
2k views

Is Rsync --link-dest Saving Space

I'm trying to use rsync and "--link-dest=" to create incremental copies of backups on a server (Debian Wheezy, LVM, RAID 1), with the goal of using hard links to save space. Unlike what may be the ...
-4
votes
2answers
30 views

what is wrong with this rsync command? [closed]

Is this syntax wrong for rsync command? The target server is using port 2222 as ssh port but I can't define it right in the rsync command. rsync -dr /home/88/public_html/download/ali -e ssh ssh -p ...
2
votes
0answers
28 views

rsync ionice softraid - limit io locally?

I know this seems to be a recurrent question but it's been troubling for a while now, so if anyone has a brilliant idea please let me know. My Setup OS Debian Wheezy HDDs 2 x 240GB SSD for ...
0
votes
1answer
68 views

rsync maintaining ownership and permissions between linux and windows ssh

I know this is is an extensively documented subject and despite the pages and pages of information ive found on it online I still cant find a definitive answer to this question so please bear with me. ...
2
votes
1answer
737 views

Unable to use rsnapshot to sync non-owned files but able to do it with plain rsync command

I am trying to use rsnapshot to sync remote file to my own computer. However, I have some trouble when I need to access files which are not owned by user who is SSH-ing to the remote machine. My ...
0
votes
1answer
27 views

What's the best way to transfer only new files down from a remote server?

I have a file server that files get dumped on through-out the day. They can be any size, any type, etc. I then want to sync those files down to a remote backup server but the trick is once they're on ...
1
vote
0answers
22 views

Simple progress for rsync when piping output to a log file

I ran rsync with nohup and --progress: nohup rsync --progress --[other-options] source destination & tail -f nohup.out When I'm tailing the file, I see the output with a changing last line ...
0
votes
0answers
28 views

Synchronize files to webserver by lsyncd

I have two webapp, old one is WS1 and the new version is WS2. Now I want to synchronize pictures/attachments from WS1 to WS2 to keep both running. I found some tools like lsyncd / unison / GlusterFS. ...
14
votes
2answers
12k views

How to repeatedly call rsync until files are sucessfully transferred

I'm trying to syncronize files from a remote server that is not reliable, meaning the connection tends to fail "randomly" with rsync: connection unexpectedly closed Rsync is called with ...
2
votes
0answers
25 views

How do I prevent rsync failure from breaking my ability to SSH into remote AWS server?

I'm running into this problem where if my rsync to an Amazon CentOS instance breaks mid-transfer (with a Ctrl+C for example), subsequent logins to the server no longer works. The Server just responds ...
17
votes
3answers
7k views

Does Rsync Allow Files To Be Synced Both Ways?

I have backed up a linux web server using rsync with cygwin. I now have a perfect copy of the server on my windows laptop. If i delete or modify a file on my laptop and run rsync again with cygwin ...
1
vote
0answers
23 views

Mystic rsync over nfs issue - same error messages but on different files every time

When I try to backup full directories, roughly half of files are copied, other half not. All error messages are all similar - No such file or directory (2) rsync: mkstemp ...
0
votes
0answers
33 views

CENTOS 6.5 x86_64 standard rsync filling cached ram while using nocache

What I'm doing: I have mounted a windows share on my server and every five minutes I move a 1.5GB file to it using this command: nocache -n 4 rsync -a -W --bwlimit=20000 /mnt/share /file/location ...
0
votes
1answer
24 views

Backup old disk to external disk (new)

One of the 2 x 500GB drives on server is crashed can read but not write the data, which both are on Hardware RAID 0. So I connected an external 1TB new drive to backup the data and replace those 2 x ...
0
votes
2answers
59 views

Permissions for rsync process to access files it doesn't own withtout running it as root

I want to use rsync to take automated backups from a remote webserver over ssh. The webserver is configured with suphp, so different sites have files with different users and groups. Unfortunately a ...
0
votes
2answers
63 views

How to increase the disk write buffer for rsync on Mac OS X?

I have to copy some TB of data from one external drive to another (mostly ~400 MB files). The source is NTFS-formatted USB2 and the best read speed I can get from it is 7MB/s. The target is HFS+ USB3 ...
7
votes
6answers
6k views

How do I copy a directory tree but not the files in Linux?

I want to copy about 200 directories & subdirectories from one location to another but I don't want to copy the thousands of files within those directories. I am on Linux. Note: I don't have ...
1
vote
1answer
111 views

Backup with rsync and exclude

I would like to do a partial backup from a server with rsync. my exclude file looks like this bin/ boot/ dev/ initrd.img initrd.img.old lib/ my problem is now, that every lib, bin and so on folder ...
0
votes
1answer
48 views

keep a minimum free space on rsync-destination

I'm using rsync to backup two folders to the same target disk in a nightly cron-job: rsync -avz /very/important/data /Backup/VID/ rsync -avz /other/stuff /Backup/tmp/ The first job backups more ...