Stack Exchange Network

Stack Exchange network consists of 174 Q&A communities including Stack Overflow, the largest, most trusted online community for developers to learn, share their knowledge, and build their careers.

Visit Stack Exchange

Questions tagged [rsync]

Rsync is a fast and extraordinarily versatile file copying tool. It can copy locally, to/from another host over any remote shell, or to/from a remote rsync daemon

-3
votes
0answers
16 views

Synchronize files between my laptop and PC [on hold]

Is there a way I could sync my user folder on both my laptop and my PC? Ideally, I would use my Linux VPS to keep the latest versions of my files and then sync to whatever device is connected. What ...
0
votes
0answers
20 views

rsync freezes over ssh

I have been using rsync over ssh successfully in the past but for a few days now, it seems to freeze when executing the rsync command. I'm using OpenSuse Leap 15. Below is an example of the outputs I ...
0
votes
1answer
42 views

CentOS 7 - systemctl - chown - unexpected remote arg

I have a custom made service file and I'm unable to run it. Here is the ExecStart line: ExecStart=/bin/rsync --ignore-existing -rtvu /var/foo/foo/ /var/foo2/foo2 && /bin/chown nginx:nginx -R /...
0
votes
0answers
17 views

Lsyncd triple-master setup

I do use lsyncd in order to sync three nodes with two sync sections in the config of each node. If a node1 fails (unreachable) and new files are being added to node2 or node3, when node1 comes back ...
0
votes
1answer
102 views

Issue running rsync from windows server 2016 to windows server 2016

I'm trying without success to copy files from one windows host to another using either cygwin or powershell and the rsync.exe. On the windows host I want to send the copy I have openssh installed, I ...
2
votes
1answer
54 views

rsync file size discrepancies [duplicate]

I have a few PC's with an ext4 filesystem that I want to backup to a file server which is also ext4. Problem is there are some discrepancies in file sizes when using rsync, and I have noticed this is ...
2
votes
1answer
51 views

High availability mirroring without separate partitions or LVM on Ubuntu 14.04 LTS

I'm on AWS with my clients for a long time now but I'm going to need cut costs now to keep providing my services. On AWS I'm using RSync to keep some folders synchronized and DRDB to provide high ...
0
votes
1answer
28 views

rsync not working after revoking public access aws ec2 instance

I have a setup where I need to copy a files from 1 ec2 instance to another instance using rsync, I used following command which worked fine rsync -ave 'ssh -i certs/cert.pem' /var/www/html/uploads/...
0
votes
0answers
19 views

NAS with DVD.ISO Images won't rsync

I have 2 NAS servers (Freenas). One is set up only to be a backup of the other. I have rsync working through the interface and it works for other files. My DVD.ISO images will not rsync. I'm not ...
-2
votes
1answer
362 views

rsync error: error in rsync protocol data stream (code 12) at io.c(600) [sender=3.0.6]

Recently I have been unable to rsync over ssh. Each time I get the same error bash: rsync: command not found rsync: connection unexpectedly closed (0 bytes received so far) [sender] rsync error: ...
0
votes
0answers
93 views

How to use rclone to sync with s3 and acl public-read

Ref: Rsync to AWS S3 bucket A reply to the above question suggests using rclone in a similar way to rsync. It seems like it might work, but it doesn't seem to use the ACL I want. Previously, I use ...
0
votes
1answer
183 views

Host Key verification failed SSH Rsync

Two days ago I started using SSH to transfer backups of two Linux servers to another one. I created a shell script to run it in Crontab. Both servers are using Ubuntu 14.04.5 LTS My SQL-Server ...
0
votes
1answer
23 views

how to create fake symlinks when copying to CIFS share with rsync

So I have to backup lot's of data to a company server. And it creates a fair share of symbolic links. I'm on a Linux Machine, and the backup server is accessed via CIFS, which does not support ...
0
votes
1answer
37 views

How to show rsync speedup

Rsync used to show an overall speedup score when the command was completed. There is even reference to the speedup value on the manpage in the --dry-run option, but it seems to have otherwise ...
0
votes
1answer
98 views

Why does rsync+cron fail with opendir permission denied?

I am trying to make a nightly offsite backup using rsync. There is a folder /media/raid1/backup that is to be uploaded to a different server every night using a cron job running as the user ...
0
votes
0answers
59 views

rsync error: packet_write_wait

I have been trying to automate a backup script which backs up my home directory (among other things) and I have been unable to fix the error $ rsync --quiet -e ssh /home/user/bkp/user.tar.lrz user@...
0
votes
1answer
95 views

Upgrading from Ubuntu 16.04 LTS to 18.04 LTS - provisioning to restore to pre-upgrade state

We have an ubuntu 16.04 LTS server that we wish to upgrade to 18.04. However if something goes wrong, we don't want to be doing a re-install of 16.04, instead we would like to be able to take a ...
1
vote
0answers
96 views

rsync compare-dest without attributes

I'm comparing a remote folder with a local folder and only copy file differences to a new folder. This is what I use: rsync -ac --compare-dest=/folder/ rsync://remote/folder/ new-folder/ My problem ...
0
votes
1answer
44 views

rsync - on uncleaned shell and connection unexpectedly closed

I want to run rync to a remote server which has an uncleaned shell. If someone tries to connect it via ssh shell, it'll show some warnings. Due to this issue I couldn't able to copy files. protocol ...
1
vote
0answers
68 views

Is there a way to tell what bottle neck is in slow rsync transfer

I am transferring a directory from a USB hard drive to my NAS device (SMB share). USB Hard Drive performance: sudo hdparm -Tt /dev/sdb /dev/sdb: Timing cached reads: 27884 MB in 1.99 seconds = ...
0
votes
1answer
515 views

rsync unexpected remote arg: user@server:/path

I'm trying to use this rsync backup script on my server. However, I get the following error (when the script tries to execute the following command: $ rsync -ar --delete -vvv -e 'ssh -i /root/.ssh/...
0
votes
1answer
73 views

rsync not accuratenly syncing large postgres dump (~30GB)

I have a large postgres dump file (~30GB) which is being rsynced (between two Ubuntu machines, both using rsync 3.1.1, protocol v31). I'm finding that the synced file matches the correct file size ...
0
votes
0answers
48 views

rsync whole VM from Azure to AWS

I am trying to move Centos 7 machine from Azure VM to AWS EC2 instance. I have some basic understanding on Linux so i need to your help in resolving what's going on here. I am using rsync in this ...
1
vote
0answers
144 views

How to reinstall boot loader on FreeBSD?

I'm planning to use rsync to clone an entire FreeBSD server to another machine, overwriting the files of the existing old FreeBSD OS (minus /etc/hostid and a few others) But that would break the boot ...
0
votes
1answer
32 views

Sync between two servers behind seperate VPNs

Trying to rsync between two servers that are behind separate VPNs, so: Server1 <-> VPN1 <-> INTERNET <-> VPN2 <-> Server2 Is there a relatively straight forward way to accomplish this?
0
votes
1answer
35 views

I want to take backup using RSYNC and never lose in backup machine

I have my all important log files in 66 server and want to take backup in .40 server using rsync. 66 server generates log every 5hours and using rsync i want to take backup in .40 server. How can do ...
0
votes
0answers
23 views

Good way to do rsync relay for a chain of network hosts

Below is the topology of network chain I have for a content syncing job: Host1 -> Host2 -> Host3 src-folder dest-folder1 dest-folder2 I plan to use rsync ...
-2
votes
1answer
43 views

How do I include a subset of files from a directory tree with rsync?

I am backing up most of an entire volume with rsync, wanting to omit the OS X overhead files and most of the files associated with a bunch of virtual machines. Omitting the overhead files works. It's ...
0
votes
1answer
247 views

Backup with rsync painfully slow

I'm using rsync to perform backups from an NFS server hosted in AWS to another EC2 instance in the same AZ, the rsync command that I'm using in the backup server is the following: rsync -avzb --...
0
votes
1answer
123 views

Rsync with rsync daemon is not preserving owners or groups

I am setting up a new internal backup strategy where multiple hosts on my LAN will be backed up to a single host running the rsync daemon. I am still in the early stages of this, backing up a ...
2
votes
2answers
77 views

Amazon EFS as code repository for auto-scaled EC2s

tl;dr: I need to set up a fast automatic sync from EFS to multiple EC2s I've set up an EC2 Auto-Scaling Group in AWS and I'm looking for the best way to manage code deployments to my instances, with ...
1
vote
1answer
347 views

Clone a remote Linux server with rsync and migrate it locally as Virtual Machine

I have a CentOS6.9 Linux server remotely on a VPS Provider and I need to clone my remote server on my local computer as a Virtual Machine for examination purposes. I made a full server backup without ...
-1
votes
1answer
78 views

how to use Rsync to synchronize data from multiple servers to one server in a folder

I'm using GlusterFS to connect 5 servers to be a big storage, now i want to transfer the data on these 5 servers to other 5 servers and i'm thinking about use Rsync to do this. It's easier if i use ...
6
votes
4answers
331 views

Rsync huge dataset of small files 5TB, +M small files

I encountered a situation where an app server misconfig led to creation of around 5TB datasets where each dir contains huge number of small files. We are in the process of transferring the files and ...
1
vote
1answer
24 views

Sync ECC archive with non-ECC backup/archive server

For archiving and backup, I created the following strategy: Server 1 (Local Network in Office) running 24/7, Linux Ubuntu NAS on DIY Odroid XU4 with Cloudshell 2 and Raid-1 (2x 8TB) this is my ...
0
votes
1answer
312 views

Cygwin Windows < Linux rsync - connection unexpectedly closed

I'm trying to backup my Raspberry Pi 3 (Raspbian) to my desktop computer (Windows 10 Pro). At the moment I can SSH each way, specifying the private key file. To SSH into the RPi from Windows: ssh ...
0
votes
3answers
226 views

Execute rsync command from script without prompt for passphrase

I use rsync to deploy code to a remote server and currently I have passphrase for the security key. How can I add the passphrase in the rsync command without a prompt to use it in a script? I don't ...
0
votes
1answer
95 views

Lsyncd exclude files or folders not working

I am using lsyncd for live syncing between master and slave and I want to exclude files like .htaccess and git files to slave server. I have configured like this: sync { default.rsync, source="/...
1
vote
6answers
99 views

What is fastest way to regularly backup large data files on weekly basis

We have automated script to backup a 200 GB data files to a local disk. the script shutdown the database , tar and compress the entire directory locally on the disk, then start the database tar -...
1
vote
2answers
35 views

Rsync tasks: prioritize link-dest over file transfer

I have a command which looks like this: rsync -avp -e ssh /folder user@server:/backups/2 --link-dest=../1 Folder number increases every day. This command runs every night, over my very very slow ...
1
vote
0answers
26 views

No space left on device (28) [duplicate]

I'm trying to use rsync to transfer nearly 4GB of files onto a remote server that is supposed to be 20GB big. On my computer, I run rsync -av --ignore-existing --inplace my_directory --compress-level=...
0
votes
2answers
275 views

rsync include/exclude filters on subdirectories

I've read dozens of other answers for this but none of them are working. I have a number of directories like this Demultiplexing/Run1/analysis/ Demultiplexing/Run1/output/ Demultiplexing/Run2/...
0
votes
0answers
10 views

How to run a rsync server that shuts itself down completely after a single connection ends?

I need that over a TCP socket, but not over ssh. I know there's an example of running --server option, but that's not documented anywhere and by the looks of it, on purpose; yet it seems it's exactly ...
0
votes
2answers
328 views

Rsync Output explanation

We have a script that "rsync" data to a remote server.That scriptt is working fine.Script that i am using is date >> /home/abc/rsyncLogs/FS1.txt rsync -zavru /FS1/ --delete --exclude-from '/...
0
votes
2answers
156 views

rsync replace existing directory with a symlink

on server1: /dir1 is a symlink to dir2 on server2: /dir1 is a directory with its own content I want to use rsync to make server2:/dir1 be a symlink to dir2, just as it is on server1. If I do this ...
3
votes
0answers
135 views

(How) should I lock a Maildir mailbox managed by Dovecot before creating a backup via rsync?

I maintain an IMAP server running Dovecot which uses Maildir as the storage format for the user mailboxes. Every night, an rsync process runs to create a backup of the mailboxes. Recently, I noticed ...
0
votes
1answer
42 views

How to run rsync with commands chained in it

I am sort of perplexed with running commands with rsync My scenario: abc.com xyz.com abc.com's root public key is added to xyz.com and vice-versa. However, I am able to do rsync with ...
0
votes
1answer
20 views

Is it possible to rsync without creating missing files?

Is it possible to rsync two directories with only updating existing on both sides files and without creating files that exist in source directory but not exist in destination directory?
0
votes
0answers
78 views

How to suppress warnings when adding `rsync` to Docker container?

I get the following warnings when adding rsync to my Docker container. Setting up rsync (3.1.0-2ubuntu0.4) ... Removing any system startup links for /etc/init.d/rsync ... update-rc.d: warning: ...
0
votes
0answers
37 views

Rsync freezes when reading from HDD, but can write to it without problems

I have SSD(system drive) and HDD. The HDD is used as backup for the SSD. I had to reinstall my Ubuntu 16.04 and now I can not transfer my backup from the HDD to the SSD using rsync(I have done it ...