Rsync is a fast and extraordinarily versatile file copying tool. It can copy locally, to/from another host over any remote shell, or to/from a remote rsync daemon

learn more… | top users | synonyms

-1
votes
2answers
25 views

Script to delete older files and copy what is left

We have a server that runs an application that is used internally. The application has a utility that creates its own backups every 24 hours. Backups are stored in: ...
1
vote
0answers
13 views

Can't access folders created by rsync on qnap server

I'm trying to use RSync to backup my files to my QNap Turbo Nas. I have activated the rsync service and created a private shared folder named "RSync". On my Windows machine I mapped a network drive ...
2
votes
1answer
54 views

Rsync takes 8+ hours to backup 15M+ files

I have ~700GB storage where I store ~15M files, hence average file size is ~50KB. To back it up, over night I run a simple rsync script with the following set of flags: --archive --update --compress ...
2
votes
1answer
37 views

Install rsync 3.1.1 on systemd

I have CentOS 7 and it comes with Rsync 3.0.9. I downloaded the 3.1.1 el7 rpm and installed with rpm -Uvh. Now the daemon refuse to start. I tried to create : ...
1
vote
0answers
16 views

rsync: Maximum nice to keep system responsive

Unfortunately a background rsync reduces the responsiveness of a server. I search a way to have maximum niceness for this background task, to keep the server respond fast. My current wrapper ...
-1
votes
2answers
66 views

Full system backup with rsync

I was reading this article about how to do a full system backup using rsync. This article assumes you have another machine with a similar linux system. What if is not the case? How different would be ...
1
vote
0answers
24 views

How to create image file and mount via. loopback (Ubuntu to remote backup space)

I've been fiddling around with the Hetzner Backup Space and I want to use rsync via. rsnapshot in order to back up my files (more info at their Wiki here) They state in their documentation: The ...
1
vote
1answer
30 views

rsync - exclude all directories except a few

There appear to be a lot of SF and SO questions out there about this, but none seem to match my requirements. source_dir/ some_dir/ another_dir/ some_file.php some_other_file.txt ...
0
votes
0answers
20 views

Rsync help: upload files with changed ones renamed?

I hope someone can help me with rsync. I have a large directory with many (thousands) subdirectories, in which I sometimes mirror (individually download) files from a remote site to work on them ...
0
votes
0answers
17 views

Rsync backup to veracrypt-encrypted USB memory stick results in errors

I have created encrypted USB memory stick using Veracrypt for backup. First sync went ok, now trying to update it results in error. I'm using this command after mounting the volume: sudo rsync ...
0
votes
1answer
19 views

Does rsync -H convert file to hard link on destination after deduplication on source?

I've got two servers, the second one being synced via rsync every now and then. I've got some (few thousands ?) of big duplicate files on which I would like to use freedup to spare some space. If I ...
1
vote
1answer
15 views

Get rsync to work incrementally

we have two syslog servers and rsync process between them. The rsync process is run every 15 minutes. We rotate the logs daily, but at the end of the day, there are still dozens of GB of logs - which ...
0
votes
1answer
25 views

rsync a directory tree with optional overlay tree

I maintain a directory structure containing dirs and files that I regularly push to ~50 hosts, which are divided into 3 groups that have slightly different needs - minor mods in a couple of files. So ...
1
vote
2answers
40 views

Restrict rsync over ssh read only / only copy from remote host

I want a backup host to be able to pull backups from a remote host. The backup host uses ssh key authentication to authenticate as a restricted user on the remote host, this user is restricted to the ...
1
vote
0answers
21 views

Virtual disk backup: rsync alternative? [closed]

We currently use rsync to backup virtual disks to another computer. Rsync is slower than direct copy, but overwrite only modified parts in the destination files. This allow to make snapshots to have ...
1
vote
1answer
35 views

How to copy a host's entire disk to another, with checksum?

Both servers are running Linux. Is rsync a suitable choice? I know it's suitable for large file transfer, file synchronization etc. But not sure about a) entire disks b) checksums. Thanks in advance. ...
2
votes
2answers
73 views

rsync hangs on one big file

Each night I copy several virtual disks with rsync from one Linux Debian computer to another Linux Debian. Most files are raw images with "holes" into them: some parts were never written to, so remain ...
2
votes
2answers
286 views

How to free memory after rsync?

I need to backup data from a web server with 10GB of RAM (Ubuntu). To backup data I use Rsync. My first test was to use one rsync for all website, but it uses 5GB. So I decided to split rsync but it ...
0
votes
0answers
25 views

Preserving destination's permissions using Cygwin's rsync

I am using Cygwin with rsync to sync files from my windows 7 computer, to a CIFS share on a Freenas Server. The command I am using is: D:\Utility\Cygwin\bin\rsync.exe -rt --delete --verbose ...
1
vote
0answers
21 views

keep writing to file after network filesystem disconnects

I'm trying to transfer a huge growing logfile in a way that will survive network partitions between the client and server. If the network connection is lost, I cannot afford to retransmit the entire ...
0
votes
0answers
20 views

Trying to clone one disk to another but one starts up with a parition and the other doesn't

I've got an Amazon EC2 m1.small that I am trying to migrate over to t2.small. I'm aware that because of the virtualization type being different on both types that there is no direct upgrade path. ...
0
votes
0answers
24 views

Copying preserving file and directory symlinks and symlink destinations

I have a directory with a bunch of files and symlinks in it, for example (not related to my actual hierarchy): src/usr/bin/ls -> src/usr/bin/busybox src/usr/bin/echo -> src/usr/bin/busybox ...
4
votes
0answers
78 views

BackupPC using rsync fails with “protocol version mismatch — is your shell clean?”

I just installed BackupPC in a Debian box to use it as backup server. As you know, this software makes use, among others, of rsync. When using the rsync option, it fails. Server: Debian Jessie. ...
0
votes
1answer
57 views

User without home access remote machine ssh

I want a production server to push backup files to a backup machine. Backups are being done via www-data cron script (as they can be edited by website cms), and once it has finished the idea is to ...
0
votes
5answers
127 views

Preserve ownership with rsync, without root

I would like to perform incremental backups (for the entire filesystem) from a machine. rsync does this quite will, however I would like to also preserve file ownership - meaning, make it possible to ...
0
votes
0answers
24 views

rsync create symlink if no referent

I use a directory which contains symlinks to different points (for backup). To make it easy, I have to add a symlink to my backup-directory and it's copied during backup process. This need of course ...
1
vote
1answer
103 views

Rsync to AWS S3 bucket

For a server I am hosting a website on I want to backup the data and settings to an S3 bucket. I found out that you can't directly use rsync to backup to an S3 bucket. Is there another way to achieve ...
0
votes
1answer
52 views

rsync syncs too much files

I have the following directory structure: /tmp1 \_ file1.txt \_ file2.txt /tmp2 \_ file1.txt \_ file2.txt \_ file3.txt /changes With rsync's --compare-dest option, I want to sync all ...
0
votes
2answers
54 views

Sync Apache Root Folder on Two Ubuntu Servers

We currently have two AWS ubuntu instance running two websites on Apache. The instances are behind a load balance. I would like to know what would be the best way to sync the root folder for both ...
1
vote
1answer
93 views

Galera Rsync SST Secured via SSL/SSH

Is it possible to secure Galera Cluster SST via rsync with SSL/SSH? This page suggests it is not, specifically the following quote: Unlike rsync, xtrabackup includes support for SSL encryption ...
1
vote
3answers
86 views

Copying data over with rsync causes size discrepancies

I am switching machines and have attached the old hard drive (/dev/sda4) to the new machine. The old machine had a slightly smaller hard drive (720G), compared to the new one (736G), so I created a ...
0
votes
1answer
15 views

Rsync exclude does not work during remote upload

I prepared an rsync code as below: /home/ra/maindir/subdir/ --exclude="/dir/config" --exclude="/dir/include/x.php" --exclude="/maindir/include/x1.php" What I am trying to do is to exclude 'config' ...
0
votes
0answers
40 views

How to find the bottleneck for slow rsync

I want to find the bottleneck for a slow rsync. I see these parts (on byte flow order): IO on source CPU on source Network CPU on destination IO on destination How can I debug this?
1
vote
1answer
50 views

Rsync --link-dest create folder only when there is something to update

Firstly, I have a hard time understanding what the --update parameter does. I thought that without it, it would logically update any file that changes and I believe that's what it does, so why does ...
1
vote
1answer
108 views

Backing up large files using rsync to external drives (NTFS) taking into consideration performance & speed

Currently files are backed up from one external hard drive to another as a means to provide the ability to restore from a secondary device should the primary external hard drive become unavailable ...
3
votes
2answers
141 views

Faster rsync of huge directory which was not changed

We use rsync to backup servers. Unfortunately the network to some servers is slow. It takes up to five minutes for rsync to detect, that nothing has changed in huge directories. These huge ...
0
votes
1answer
30 views

Rsync: locally cache files to be sent over slow link?

This is regarding the incremental hard-link method of backups, making a daily directory containing a copy of hard links to the original files, and rsync deleting the hardlinks and placing new files ...
-1
votes
1answer
161 views

Can I backup a dovecot account via rsync?

I would like to backup a remote dovecot account to my local disc. The docs explain a tool which seems to support only a "push", not a "pull" way of backup: http://wiki2.dovecot.org/Tools/Doveadm/Sync ...
-4
votes
2answers
31 views

what is wrong with this rsync command? [closed]

Is this syntax wrong for rsync command? The target server is using port 2222 as ssh port but I can't define it right in the rsync command. rsync -dr /home/88/public_html/download/ali -e ssh ssh -p ...
2
votes
0answers
34 views

rsync ionice softraid - limit io locally?

I know this seems to be a recurrent question but it's been troubling for a while now, so if anyone has a brilliant idea please let me know. My Setup OS Debian Wheezy HDDs 2 x 240GB SSD for ...
1
vote
1answer
59 views

Rsync can view modules and retrieve files, but not send

I am setting up rsync to synchronize files between two separated servers (A and B) in different networks, both running Solaris 10 OS. I am using --daemon. Right now, I am able to get the module list ...
0
votes
1answer
116 views

rsync maintaining ownership and permissions between linux and windows ssh

I know this is is an extensively documented subject and despite the pages and pages of information ive found on it online I still cant find a definitive answer to this question so please bear with me. ...
2
votes
3answers
949 views

Rsync hangs: expand file_list pointer array to N bytes, did move

Rsync is going into "interruptible sleep" mode after transferring some files from a local folder to a NFS folder. The folder I am trying to backup contains more than 180gb of data. This is what rsync ...
0
votes
1answer
32 views

What's the best way to transfer only new files down from a remote server?

I have a file server that files get dumped on through-out the day. They can be any size, any type, etc. I then want to sync those files down to a remote backup server but the trick is once they're on ...
1
vote
0answers
29 views

Simple progress for rsync when piping output to a log file

I ran rsync with nohup and --progress: nohup rsync --progress --[other-options] source destination & tail -f nohup.out When I'm tailing the file, I see the output with a changing last line ...
0
votes
0answers
71 views

Synchronize files to webserver by lsyncd

I have two webapp, old one is WS1 and the new version is WS2. Now I want to synchronize pictures/attachments from WS1 to WS2 to keep both running. I found some tools like lsyncd / unison / GlusterFS. ...
1
vote
2answers
90 views

rsync files to a kubernetes pod

I need to rsync a file tree to a specific pod in a kubernetes cluster. It seems it should be possible if only one can convince rsync that kubectl acts sort of like rsh. Something like: rsync ...
2
votes
0answers
41 views

How do I prevent rsync failure from breaking my ability to SSH into remote AWS server?

I'm running into this problem where if my rsync to an Amazon CentOS instance breaks mid-transfer (with a Ctrl+C for example), subsequent logins to the server no longer works. The Server just responds ...
5
votes
4answers
234 views

rsync directory so all changes appear atomically

I do some nightly and weekly mirrors of frequently used repositories for the local network. On a few occasions, someone has tried to do an update while the rsync is happening and failed because the ...
0
votes
1answer
28 views

Backup old disk to external disk (new)

One of the 2 x 500GB drives on server is crashed can read but not write the data, which both are on Hardware RAID 0. So I connected an external 1TB new drive to backup the data and replace those 2 x ...