Rsync is a fast and extraordinarily versatile file copying tool. It can copy locally, to/from another host over any remote shell, or to/from a remote rsync daemon

learn more… | top users | synonyms

0
votes
0answers
7 views

Rsync hard-links when modification times are different

I have a large remote directory A and local directory B that are nearly identical in content, though many of the modification times may have changed by copying files etc. I want to create a local ...
-2
votes
2answers
32 views

Windows samba share much slower that rsync

I have a samba share installed on a Debian server. This is mounted on a windows 7 machine. When I am trying to copy to a 5 GB file to my Windows machine, the speed is around 600 kb/s. However, when ...
0
votes
1answer
19 views

rsync: connection unexpectedly closed - No tty present

I'm having issues trying to rsync files over from a build server to a web server. the command im running is rsync -e "ssh -i ${HOME}/.ssh/id_rsa" --rsync-path="sudo rsync" -avh --chown=nobody:webdev ...
0
votes
2answers
19 views

Inotify & Rsync - Don't move files before download is completed

I am using a local website which downloads files to my server. Using an Inotify daemon I'm listening for file changes in a specific folder (the one I am downloading to) and executing a script which ...
0
votes
2answers
29 views

Rsync to remote server and change file / directory ownerships

I am using Rsync to deploy to a remote server, which is working. However the file and directory ownership always replaces old files with root:root I need the ownership of all files and folders ...
0
votes
1answer
46 views

NFS drive full even though du says it's not [closed]

I am experiencing a very weird behaviour of my backup drive that I can neither explain nor get fixed. I have an external drive mounted via NFS. I regularly call rsync jobs that backup files from my ...
2
votes
2answers
24 views

rsync: ignore files in use (being written to)

I have an SFTP server where clients are constantly uploading large files. On a periodic basis, I want to copy all complete (fully uploaded) files to another machine for processing. I don't want to ...
0
votes
1answer
27 views

rsync: no lockfile created on system reboot

After system reboot rsync starts but no lock file is created, therefore when rsync on a remote machine tries to get a directory for backup it fails with @ERROR: failed to open lock file rsync error: ...
0
votes
2answers
90 views

why does 'rsync --delete-before' delete files from target that still exist at the source?

I have a centOS 7.1 linux box with rsync 3.1.1. There are files there that I want to transfer to a FreeNAS 9.10 machine. For this I've set up an rsync daemon on freeNAS and transferring files works ...
-1
votes
2answers
37 views

Script to delete older files and copy what is left

We have a server that runs an application that is used internally. The application has a utility that creates its own backups every 24 hours. Backups are stored in: ...
1
vote
0answers
43 views

Can't access folders created by rsync on qnap server

I'm trying to use RSync to backup my files to my QNap Turbo Nas. I have activated the rsync service and created a private shared folder named "RSync". On my Windows machine I mapped a network drive ...
3
votes
1answer
74 views

Rsync takes 8+ hours to backup 15M+ files

I have ~700GB storage where I store ~15M files, hence average file size is ~50KB. To back it up, over night I run a simple rsync script with the following set of flags: --archive --update --compress ...
2
votes
2answers
90 views

Install rsync 3.1.1 on systemd

I have CentOS 7 and it comes with Rsync 3.0.9. I downloaded the 3.1.1 el7 rpm and installed with rpm -Uvh. Now the daemon refuse to start. I tried to create : ...
1
vote
0answers
17 views

rsync: Maximum nice to keep system responsive

Unfortunately a background rsync reduces the responsiveness of a server. I search a way to have maximum niceness for this background task, to keep the server respond fast. My current wrapper ...
-1
votes
2answers
83 views

Full system backup with rsync

I was reading this article about how to do a full system backup using rsync. This article assumes you have another machine with a similar linux system. What if is not the case? How different would be ...
1
vote
0answers
57 views

How to create image file and mount via. loopback (Ubuntu to remote backup space)

I've been fiddling around with the Hetzner Backup Space and I want to use rsync via. rsnapshot in order to back up my files (more info at their Wiki here) They state in their documentation: The ...
1
vote
1answer
38 views

rsync - exclude all directories except a few

There appear to be a lot of SF and SO questions out there about this, but none seem to match my requirements. source_dir/ some_dir/ another_dir/ some_file.php some_other_file.txt ...
0
votes
0answers
20 views

Rsync help: upload files with changed ones renamed?

I hope someone can help me with rsync. I have a large directory with many (thousands) subdirectories, in which I sometimes mirror (individually download) files from a remote site to work on them ...
0
votes
0answers
25 views

Rsync backup to veracrypt-encrypted USB memory stick results in errors

I have created encrypted USB memory stick using Veracrypt for backup. First sync went ok, now trying to update it results in error. I'm using this command after mounting the volume: sudo rsync ...
0
votes
1answer
20 views

Does rsync -H convert file to hard link on destination after deduplication on source?

I've got two servers, the second one being synced via rsync every now and then. I've got some (few thousands ?) of big duplicate files on which I would like to use freedup to spare some space. If I ...
1
vote
1answer
20 views

Get rsync to work incrementally

we have two syslog servers and rsync process between them. The rsync process is run every 15 minutes. We rotate the logs daily, but at the end of the day, there are still dozens of GB of logs - which ...
0
votes
1answer
34 views

rsync a directory tree with optional overlay tree

I maintain a directory structure containing dirs and files that I regularly push to ~50 hosts, which are divided into 3 groups that have slightly different needs - minor mods in a couple of files. So ...
1
vote
2answers
57 views

Restrict rsync over ssh read only / only copy from remote host

I want a backup host to be able to pull backups from a remote host. The backup host uses ssh key authentication to authenticate as a restricted user on the remote host, this user is restricted to the ...
1
vote
0answers
23 views

Virtual disk backup: rsync alternative? [closed]

We currently use rsync to backup virtual disks to another computer. Rsync is slower than direct copy, but overwrite only modified parts in the destination files. This allow to make snapshots to have ...
1
vote
1answer
38 views

How to copy a host's entire disk to another, with checksum?

Both servers are running Linux. Is rsync a suitable choice? I know it's suitable for large file transfer, file synchronization etc. But not sure about a) entire disks b) checksums. Thanks in advance. ...
2
votes
2answers
95 views

rsync hangs on one big file

Each night I copy several virtual disks with rsync from one Linux Debian computer to another Linux Debian. Most files are raw images with "holes" into them: some parts were never written to, so remain ...
2
votes
2answers
296 views

How to free memory after rsync?

I need to backup data from a web server with 10GB of RAM (Ubuntu). To backup data I use Rsync. My first test was to use one rsync for all website, but it uses 5GB. So I decided to split rsync but it ...
0
votes
0answers
35 views

Preserving destination's permissions using Cygwin's rsync

I am using Cygwin with rsync to sync files from my windows 7 computer, to a CIFS share on a Freenas Server. The command I am using is: D:\Utility\Cygwin\bin\rsync.exe -rt --delete --verbose ...
1
vote
0answers
22 views

keep writing to file after network filesystem disconnects

I'm trying to transfer a huge growing logfile in a way that will survive network partitions between the client and server. If the network connection is lost, I cannot afford to retransmit the entire ...
0
votes
0answers
20 views

Trying to clone one disk to another but one starts up with a parition and the other doesn't

I've got an Amazon EC2 m1.small that I am trying to migrate over to t2.small. I'm aware that because of the virtualization type being different on both types that there is no direct upgrade path. ...
0
votes
0answers
27 views

Copying preserving file and directory symlinks and symlink destinations

I have a directory with a bunch of files and symlinks in it, for example (not related to my actual hierarchy): src/usr/bin/ls -> src/usr/bin/busybox src/usr/bin/echo -> src/usr/bin/busybox ...
4
votes
0answers
87 views

BackupPC using rsync fails with “protocol version mismatch — is your shell clean?”

I just installed BackupPC in a Debian box to use it as backup server. As you know, this software makes use, among others, of rsync. When using the rsync option, it fails. Server: Debian Jessie. ...
0
votes
1answer
73 views

User without home access remote machine ssh

I want a production server to push backup files to a backup machine. Backups are being done via www-data cron script (as they can be edited by website cms), and once it has finished the idea is to ...
0
votes
5answers
166 views

Preserve ownership with rsync, without root

I would like to perform incremental backups (for the entire filesystem) from a machine. rsync does this quite will, however I would like to also preserve file ownership - meaning, make it possible to ...
0
votes
0answers
27 views

rsync create symlink if no referent

I use a directory which contains symlinks to different points (for backup). To make it easy, I have to add a symlink to my backup-directory and it's copied during backup process. This need of course ...
2
votes
1answer
138 views

Rsync to AWS S3 bucket

For a server I am hosting a website on I want to backup the data and settings to an S3 bucket. I found out that you can't directly use rsync to backup to an S3 bucket. Is there another way to achieve ...
0
votes
1answer
54 views

rsync syncs too much files

I have the following directory structure: /tmp1 \_ file1.txt \_ file2.txt /tmp2 \_ file1.txt \_ file2.txt \_ file3.txt /changes With rsync's --compare-dest option, I want to sync all ...
0
votes
2answers
64 views

Sync Apache Root Folder on Two Ubuntu Servers

We currently have two AWS ubuntu instance running two websites on Apache. The instances are behind a load balance. I would like to know what would be the best way to sync the root folder for both ...
1
vote
1answer
123 views

Galera Rsync SST Secured via SSL/SSH

Is it possible to secure Galera Cluster SST via rsync with SSL/SSH? This page suggests it is not, specifically the following quote: Unlike rsync, xtrabackup includes support for SSL encryption ...
1
vote
3answers
87 views

Copying data over with rsync causes size discrepancies

I am switching machines and have attached the old hard drive (/dev/sda4) to the new machine. The old machine had a slightly smaller hard drive (720G), compared to the new one (736G), so I created a ...
0
votes
1answer
16 views

Rsync exclude does not work during remote upload

I prepared an rsync code as below: /home/ra/maindir/subdir/ --exclude="/dir/config" --exclude="/dir/include/x.php" --exclude="/maindir/include/x1.php" What I am trying to do is to exclude 'config' ...
0
votes
0answers
45 views

How to find the bottleneck for slow rsync

I want to find the bottleneck for a slow rsync. I see these parts (on byte flow order): IO on source CPU on source Network CPU on destination IO on destination How can I debug this?
1
vote
1answer
51 views

Rsync --link-dest create folder only when there is something to update

Firstly, I have a hard time understanding what the --update parameter does. I thought that without it, it would logically update any file that changes and I believe that's what it does, so why does ...
1
vote
1answer
126 views

Backing up large files using rsync to external drives (NTFS) taking into consideration performance & speed

Currently files are backed up from one external hard drive to another as a means to provide the ability to restore from a secondary device should the primary external hard drive become unavailable ...
3
votes
2answers
171 views

Faster rsync of huge directory which was not changed

We use rsync to backup servers. Unfortunately the network to some servers is slow. It takes up to five minutes for rsync to detect, that nothing has changed in huge directories. These huge ...
0
votes
1answer
35 views

Rsync: locally cache files to be sent over slow link?

This is regarding the incremental hard-link method of backups, making a daily directory containing a copy of hard links to the original files, and rsync deleting the hardlinks and placing new files ...
-1
votes
1answer
215 views

Can I backup a dovecot account via rsync?

I would like to backup a remote dovecot account to my local disc. The docs explain a tool which seems to support only a "push", not a "pull" way of backup: http://wiki2.dovecot.org/Tools/Doveadm/Sync ...
-4
votes
2answers
32 views

what is wrong with this rsync command? [closed]

Is this syntax wrong for rsync command? The target server is using port 2222 as ssh port but I can't define it right in the rsync command. rsync -dr /home/88/public_html/download/ali -e ssh ssh -p ...
2
votes
0answers
38 views

rsync ionice softraid - limit io locally?

I know this seems to be a recurrent question but it's been troubling for a while now, so if anyone has a brilliant idea please let me know. My Setup OS Debian Wheezy HDDs 2 x 240GB SSD for ...
1
vote
1answer
61 views

Rsync can view modules and retrieve files, but not send

I am setting up rsync to synchronize files between two separated servers (A and B) in different networks, both running Solaris 10 OS. I am using --daemon. Right now, I am able to get the module list ...