Stack Exchange Network

Stack Exchange network consists of 174 Q&A communities including Stack Overflow, the largest, most trusted online community for developers to learn, share their knowledge, and build their careers.

Visit Stack Exchange
Join us in building a kind, collaborative learning community via our updated Code of Conduct.

Questions tagged [rsync]

Rsync is a fast and extraordinarily versatile file copying tool. It can copy locally, to/from another host over any remote shell, or to/from a remote rsync daemon

0
votes
0answers
13 views

Host Key verification failed SSH Rsync

Two days ago I started using SSH to transfer backups of two Linux servers to another one. I created a shell script to run it in Crontab. Both servers are using Ubuntu 14.04.5 LTS My SQL-Server ...
0
votes
1answer
11 views

how to create fake symlinks when copying to CIFS share with rsync

So I have to backup lot's of data to a company server. And it creates a fair share of symbolic links. I'm on a Linux Machine, and the backup server is accessed via CIFS, which does not support ...
0
votes
1answer
17 views

How to show rsync speedup

Rsync used to show an overall speedup score when the command was completed. There is even reference to the speedup value on the manpage in the --dry-run option, but it seems to have otherwise ...
0
votes
1answer
27 views

Why does rsync+cron fail with opendir permission denied?

I am trying to make a nightly offsite backup using rsync. There is a folder /media/raid1/backup that is to be uploaded to a different server every night using a cron job running as the user ...
0
votes
0answers
10 views

rsync error: packet_write_wait

I have been trying to automate a backup script which backs up my home directory (among other things) and I have been unable to fix the error $ rsync --quiet -e ssh /home/user/bkp/user.tar.lrz user@...
0
votes
0answers
35 views

Upgrading from Ubuntu 16.04 LTS to 18.04 LTS - provisioning to restore to pre-upgrade state

We have an ubuntu 16.04 LTS server that we wish to upgrade to 18.04. However if something goes wrong, we don't want to be doing a re-install of 16.04, instead we would like to be able to take a ...
1
vote
0answers
62 views

rsync compare-dest without attributes

I'm comparing a remote folder with a local folder and only copy file differences to a new folder. This is what I use: rsync -ac --compare-dest=/folder/ rsync://remote/folder/ new-folder/ My problem ...
0
votes
1answer
32 views

rsync - on uncleaned shell and connection unexpectedly closed

I want to run rync to a remote server which has an uncleaned shell. If someone tries to connect it via ssh shell, it'll show some warnings. Due to this issue I couldn't able to copy files. protocol ...
1
vote
0answers
56 views

Is there a way to tell what bottle neck is in slow rsync transfer

I am transferring a directory from a USB hard drive to my NAS device (SMB share). USB Hard Drive performance: sudo hdparm -Tt /dev/sdb /dev/sdb: Timing cached reads: 27884 MB in 1.99 seconds = ...
0
votes
1answer
185 views

rsync unexpected remote arg: user@server:/path

I'm trying to use this rsync backup script on my server. However, I get the following error (when the script tries to execute the following command: $ rsync -ar --delete -vvv -e 'ssh -i /root/.ssh/...
0
votes
1answer
52 views

rsync not accuratenly syncing large postgres dump (~30GB)

I have a large postgres dump file (~30GB) which is being rsynced (between two Ubuntu machines, both using rsync 3.1.1, protocol v31). I'm finding that the synced file matches the correct file size ...
0
votes
0answers
40 views

rsync whole VM from Azure to AWS

I am trying to move Centos 7 machine from Azure VM to AWS EC2 instance. I have some basic understanding on Linux so i need to your help in resolving what's going on here. I am using rsync in this ...
1
vote
0answers
54 views

How to reinstall boot loader on FreeBSD?

I'm planning to use rsync to clone an entire FreeBSD server to another machine, overwriting the files of the existing old FreeBSD OS (minus /etc/hostid and a few others) But that would break the boot ...
0
votes
1answer
29 views

Sync between two servers behind seperate VPNs

Trying to rsync between two servers that are behind separate VPNs, so: Server1 <-> VPN1 <-> INTERNET <-> VPN2 <-> Server2 Is there a relatively straight forward way to accomplish this?
0
votes
1answer
35 views

I want to take backup using RSYNC and never lose in backup machine

I have my all important log files in 66 server and want to take backup in .40 server using rsync. 66 server generates log every 5hours and using rsync i want to take backup in .40 server. How can do ...
0
votes
0answers
19 views

Good way to do rsync relay for a chain of network hosts

Below is the topology of network chain I have for a content syncing job: Host1 -> Host2 -> Host3 src-folder dest-folder1 dest-folder2 I plan to use rsync ...
-2
votes
1answer
38 views

How do I include a subset of files from a directory tree with rsync?

I am backing up most of an entire volume with rsync, wanting to omit the OS X overhead files and most of the files associated with a bunch of virtual machines. Omitting the overhead files works. It's ...
0
votes
1answer
91 views

Backup with rsync painfully slow

I'm using rsync to perform backups from an NFS server hosted in AWS to another EC2 instance in the same AZ, the rsync command that I'm using in the backup server is the following: rsync -avzb --...
0
votes
1answer
74 views

Rsync with rsync daemon is not preserving owners or groups

I am setting up a new internal backup strategy where multiple hosts on my LAN will be backed up to a single host running the rsync daemon. I am still in the early stages of this, backing up a ...
1
vote
2answers
42 views

Amazon EFS as code repository for auto-scaled EC2s

tl;dr: I need to set up a fast automatic sync from EFS to multiple EC2s I've set up an EC2 Auto-Scaling Group in AWS and I'm looking for the best way to manage code deployments to my instances, with ...
1
vote
1answer
120 views

Clone a remote Linux server with rsync and migrate it locally as Virtual Machine

I have a CentOS6.9 Linux server remotely on a VPS Provider and I need to clone my remote server on my local computer as a Virtual Machine for examination purposes. I made a full server backup without ...
-1
votes
1answer
72 views

how to use Rsync to synchronize data from multiple servers to one server in a folder

I'm using GlusterFS to connect 5 servers to be a big storage, now i want to transfer the data on these 5 servers to other 5 servers and i'm thinking about use Rsync to do this. It's easier if i use ...
5
votes
4answers
202 views

Rsync huge dataset of small files 5TB, +M small files

I encountered a situation where an app server misconfig led to creation of around 5TB datasets where each dir contains huge number of small files. We are in the process of transferring the files and ...
1
vote
1answer
22 views

Sync ECC archive with non-ECC backup/archive server

For archiving and backup, I created the following strategy: Server 1 (Local Network in Office) running 24/7, Linux Ubuntu NAS on DIY Odroid XU4 with Cloudshell 2 and Raid-1 (2x 8TB) this is my ...
0
votes
1answer
168 views

Cygwin Windows < Linux rsync - connection unexpectedly closed

I'm trying to backup my Raspberry Pi 3 (Raspbian) to my desktop computer (Windows 10 Pro). At the moment I can SSH each way, specifying the private key file. To SSH into the RPi from Windows: ssh ...
0
votes
3answers
104 views

Execute rsync command from script without prompt for passphrase

I use rsync to deploy code to a remote server and currently I have passphrase for the security key. How can I add the passphrase in the rsync command without a prompt to use it in a script? I don't ...
0
votes
0answers
39 views

Lsyncd exclude files or folders not working

I am using lsyncd for live syncing between master and slave and I want to exclude files like .htaccess and git files to slave server. I have configured like this: sync { default.rsync, source="/...
1
vote
6answers
83 views

What is fastest way to regularly backup large data files on weekly basis

We have automated script to backup a 200 GB data files to a local disk. the script shutdown the database , tar and compress the entire directory locally on the disk, then start the database tar -...
1
vote
2answers
30 views

Rsync tasks: prioritize link-dest over file transfer

I have a command which looks like this: rsync -avp -e ssh /folder user@server:/backups/2 --link-dest=../1 Folder number increases every day. This command runs every night, over my very very slow ...
1
vote
0answers
26 views

No space left on device (28) [duplicate]

I'm trying to use rsync to transfer nearly 4GB of files onto a remote server that is supposed to be 20GB big. On my computer, I run rsync -av --ignore-existing --inplace my_directory --compress-level=...
0
votes
2answers
162 views

rsync include/exclude filters on subdirectories

I've read dozens of other answers for this but none of them are working. I have a number of directories like this Demultiplexing/Run1/analysis/ Demultiplexing/Run1/output/ Demultiplexing/Run2/...
0
votes
0answers
10 views

How to run a rsync server that shuts itself down completely after a single connection ends?

I need that over a TCP socket, but not over ssh. I know there's an example of running --server option, but that's not documented anywhere and by the looks of it, on purpose; yet it seems it's exactly ...
0
votes
2answers
160 views

Rsync Output explanation

We have a script that "rsync" data to a remote server.That scriptt is working fine.Script that i am using is date >> /home/abc/rsyncLogs/FS1.txt rsync -zavru /FS1/ --delete --exclude-from '/...
0
votes
2answers
138 views

rsync replace existing directory with a symlink

on server1: /dir1 is a symlink to dir2 on server2: /dir1 is a directory with its own content I want to use rsync to make server2:/dir1 be a symlink to dir2, just as it is on server1. If I do this ...
3
votes
0answers
87 views

(How) should I lock a Maildir mailbox managed by Dovecot before creating a backup via rsync?

I maintain an IMAP server running Dovecot which uses Maildir as the storage format for the user mailboxes. Every night, an rsync process runs to create a backup of the mailboxes. Recently, I noticed ...
0
votes
1answer
40 views

How to run rsync with commands chained in it

I am sort of perplexed with running commands with rsync My scenario: abc.com xyz.com abc.com's root public key is added to xyz.com and vice-versa. However, I am able to do rsync with ...
0
votes
1answer
19 views

Is it possible to rsync without creating missing files?

Is it possible to rsync two directories with only updating existing on both sides files and without creating files that exist in source directory but not exist in destination directory?
0
votes
0answers
43 views

How to suppress warnings when adding `rsync` to Docker container?

I get the following warnings when adding rsync to my Docker container. Setting up rsync (3.1.0-2ubuntu0.4) ... Removing any system startup links for /etc/init.d/rsync ... update-rc.d: warning: ...
0
votes
0answers
35 views

Rsync freezes when reading from HDD, but can write to it without problems

I have SSD(system drive) and HDD. The HDD is used as backup for the SSD. I had to reinstall my Ubuntu 16.04 and now I can not transfer my backup from the HDD to the SSD using rsync(I have done it ...
13
votes
1answer
555 views

Does rsync change file content (dealing with hardlinks)?

Imagine I have a file remote/A which syncs to local/A and local/B is a hardlink of local/A. Is there a threat that on a next remote/A change and synchronization rsync will not delete local/A but only ...
0
votes
0answers
155 views

rsync stopped working. unexplained error (code 130)

I have a script that has the following line: rsync -e "ssh -i /home/me/.ssh/id_rsa" -a /home/me/ws/ me@example.com:/pathtobackups/$(date +%FT%R)/ It has worked for a couple of months, but suddenly ...
0
votes
1answer
130 views

Sync files between GCLOUD instances of same group

Have four instances in GCLOUD with SO: Linux (Ubuntu). I have to replicate the files uploaded through ftp to one machine and then to the remaining 3 machines. I have been thinking to use Rsync, but I ...
0
votes
0answers
30 views

BackupPC — RsyncArgs and RsyncArgsExtra

BackupPC has two config options: $Conf{RsyncArgs} and $Conf{RsyncArgsExtra}. Short question -- Can I be assured that $Conf{RsyncArgs} comes before $Conf{RsyncArgsExtra}? Longer background -- I'm ...
0
votes
0answers
130 views

How to kill rsync daemon that keeps respawning

How do I kill these rsync daemons that keep respawning root@que2 ~ # ps aux | grep rsync root 9660 0.0 0.0 19928 2844 ? S 13:35 0:00 rsync -rlptD --progress --delete --exclude=server/...
0
votes
1answer
12 views

DU shows fluctuating up then down totals during active rsync

I have 2 CentOS systems, one is rsyncing a ~411 gig directory to another. On the receiving system, I typically run du -cs * |grep total;sleep 5 as a way to monitor the background rsync operation and ...
0
votes
0answers
45 views

rsync to much upload data

I have an issue with an incremental backup using rsync. My issue rsync that it sends 150 GB of data to the backup server, however only 10 GB maximum have been changed on the server. I can't figure out ...
0
votes
1answer
68 views

rsync does not create a directory backup

Let's say that I have a directory with files: a b c d So I copy with rsync: rsync -av --delete -P --backup --backup-dir=sample-$(date +%a-%H%M) ../sample /backups I get in /backup/sample: -rw-r--...
0
votes
1answer
134 views

How to copy more than 300GB files one AWS EC2 server to another EC2

I need to copy more than 300 GB files (most them are images) one EC2 instance to another EC2 instance, what will be the best method for doing this? EBS Snapshot will be not work in my situation ...
0
votes
0answers
125 views

Rsync exclude only contents using asterisk not working

i was recently tasked with setting up a rather complicated deploy script using rsync and i was asked to have it use the --delete option which removes files in the destination that are not in the ...
3
votes
1answer
573 views

“protocol version mismatch — is your shell clean?” rsync error when the shell IS clean

I'm trying to download files using rsync with rsync running in daemon mode over SSH on the server and get the following error on the client: rsync -a myserver:/remote/path/ localdestdir/ protocol ...