Stack Exchange Network

Stack Exchange network consists of 174 Q&A communities including Stack Overflow, the largest, most trusted online community for developers to learn, share their knowledge, and build their careers.

Visit Stack Exchange

Questions tagged [rsync]

Rsync is a fast and extraordinarily versatile file copying tool. It can copy locally, to/from another host over any remote shell, or to/from a remote rsync daemon

-1
votes
0answers
34 views

RSYNC fails after 2GB

When using RSYNC on a Linux machine to a Windows SMB share the file gets to 2.0 GB of 6.3 GB and errors. This has started since disabling SMB1 on the Windows share. I have re-mapped the share using ...
0
votes
0answers
6 views

Backup files from server (static IP) to home server (Dynamic IP) [migrated]

I am already familiar and use rsync, scp transfers, tar, 7z etc however none of which solve a backup I intend to do rather regularly. I have a remote server with 80% used space on 100GB SSD that I ...
0
votes
1answer
51 views

Did my rsync successfully back-up all data or not?

It looks like not a single byte is missing after the rsync, but there were some errors: ujjain@DS3018xs:/volume1$ cat rsync.sh rsync -av photo.tar /var/services/homes/ujjain/nfs/RAIDF1/ rsync -av ...
0
votes
0answers
11 views

rsync folder synchronization ignoring deletes (mixed Linux/Windows)

I have a need to synchronize two large folder structures, with the additional caveat such that: Only NEW or CHANGED files on the source are copied Existing files/folders on the source are NOT copied,...
1
vote
0answers
42 views

rsync --link-dest. Time to 'building file list" incrementing

I've been running rsync as a cygwin task on Windows Server 2008 for about two months now. I'm using the --link-dest option to do a daily 'snapshot' of the contents of a server containing about 10TB ...
0
votes
0answers
54 views

Remote incremental backups with rsync?

I'm trying to set up rsync to send incremental backups to a remote server. The first backup would go to a "backup" folder, then the next backup would send only the changes to a "backup.1" folder, and ...
0
votes
1answer
22 views

exclude/include rules of rsync

I need to include in rsync rules only .local/shares/ no other directory in .local/ and exclude certain directories from /.local/shares. My rules are currently as such: + /.local/share/ + /.local/...
0
votes
0answers
34 views

Data loss after disrupting rsync process

i have a Linux Shell script that is archiving files via rsync. After copying the files to destination the source files should be deleted. Only files older than 90 days should be archived. See my ...
1
vote
1answer
53 views

ZFS pool size discrepancy after rsync-ing

I am trying to rsync data one of the volumes in a ZFS pool to an exfat formatted drive. The volume is only 1.3 TB but the rsync got up to syncing 3+ TB worth of data. I killed the rsync so I could ...
2
votes
1answer
19 views

rsync -av -e “ssh”, plus a bunch of “includes” with an ending “exclude='*''”, not copying all files

An rsync command that looks like of like this, rsync -av -e "ssh" --include="dir1" --include="dir2" --include="dir3" --include="file1" --include="file2" --include="file3" --exclude="*" user@server:/...
1
vote
2answers
37 views

rsync ignores --chown/--usermap

I'm running ansible with the synchronize module, which underneath runs rsync. My problem is not ansible-related, as I took the rsync command from the debug output and ran it manually - still the same ...
1
vote
1answer
65 views

ssh login passwdless works,but rsync not on Centos7

I want to backup server files automatically,so I try to do it with rsync. I use below command to ssh login passwordless. ssk-keygen ssh-copy-id root@ss1.xxxxx100.com ssh-copy-id backup@ss1.xxxx100....
0
votes
0answers
22 views

rsync + find & replace string on all incoming files

I am using rsync to sync my development server with my production server. To make things easier, how can I pipe all the files so that all instances of a string are replaced with another during the ...
0
votes
2answers
47 views

Advices for 1.5m files syncing with rsync

I have a folder with about 1.5 million files and I need them to be copied to a secondary server as often as possible. What would you recommend because clearly standard rsync commands do not make it ...
0
votes
1answer
59 views

Auto backup and delete a project directory using cronjob

I am trying to backup a directory, location: /mnt/project/ once in 24 hrs, and another directory inside the parent directory, location: /mnt/project/uploadDocuments/ every 3 hours using cronjob. ...
0
votes
2answers
70 views

Call rsync with args stored in a string

This is the same script as the one cited in my mhddfs thread, I'd like to define the args according to some inputs, and call rasync afterwards. I currently came up with this but only the call to rsync ...
0
votes
0answers
47 views

rsync freezes over ssh

I have been using rsync over ssh successfully in the past but for a few days now, it seems to freeze when executing the rsync command. I'm using OpenSuse Leap 15. Below is an example of the outputs I ...
0
votes
1answer
73 views

CentOS 7 - systemctl - chown - unexpected remote arg

I have a custom made service file and I'm unable to run it. Here is the ExecStart line: ExecStart=/bin/rsync --ignore-existing -rtvu /var/foo/foo/ /var/foo2/foo2 && /bin/chown nginx:nginx -R /...
0
votes
0answers
34 views

Lsyncd triple-master setup

I do use lsyncd in order to sync three nodes with two sync sections in the config of each node. If a node1 fails (unreachable) and new files are being added to node2 or node3, when node1 comes back ...
2
votes
1answer
369 views

Issue running rsync from windows server 2016 to windows server 2016

I'm trying without success to copy files from one windows host to another using either cygwin or powershell and the rsync.exe. On the windows host I want to send the copy I have openssh installed, I ...
2
votes
1answer
77 views

rsync file size discrepancies [duplicate]

I have a few PC's with an ext4 filesystem that I want to backup to a file server which is also ext4. Problem is there are some discrepancies in file sizes when using rsync, and I have noticed this is ...
2
votes
1answer
72 views

High availability mirroring without separate partitions or LVM on Ubuntu 14.04 LTS

I'm on AWS with my clients for a long time now but I'm going to need cut costs now to keep providing my services. On AWS I'm using RSync to keep some folders synchronized and DRDB to provide high ...
0
votes
1answer
40 views

rsync not working after revoking public access aws ec2 instance

I have a setup where I need to copy a files from 1 ec2 instance to another instance using rsync, I used following command which worked fine rsync -ave 'ssh -i certs/cert.pem' /var/www/html/uploads/...
0
votes
0answers
21 views

NAS with DVD.ISO Images won't rsync

I have 2 NAS servers (Freenas). One is set up only to be a backup of the other. I have rsync working through the interface and it works for other files. My DVD.ISO images will not rsync. I'm not ...
-2
votes
1answer
1k views

rsync error: error in rsync protocol data stream (code 12) at io.c(600) [sender=3.0.6]

Recently I have been unable to rsync over ssh. Each time I get the same error bash: rsync: command not found rsync: connection unexpectedly closed (0 bytes received so far) [sender] rsync error: ...
0
votes
0answers
245 views

How to use rclone to sync with s3 and acl public-read

Ref: Rsync to AWS S3 bucket A reply to the above question suggests using rclone in a similar way to rsync. It seems like it might work, but it doesn't seem to use the ACL I want. Previously, I use ...
0
votes
1answer
263 views

Host Key verification failed SSH Rsync

Two days ago I started using SSH to transfer backups of two Linux servers to another one. I created a shell script to run it in Crontab. Both servers are using Ubuntu 14.04.5 LTS My SQL-Server ...
0
votes
1answer
74 views

how to create fake symlinks when copying to CIFS share with rsync

So I have to backup lot's of data to a company server. And it creates a fair share of symbolic links. I'm on a Linux Machine, and the backup server is accessed via CIFS, which does not support ...
0
votes
1answer
96 views

How to show rsync speedup

Rsync used to show an overall speedup score when the command was completed. There is even reference to the speedup value on the manpage in the --dry-run option, but it seems to have otherwise ...
0
votes
1answer
144 views

Why does rsync+cron fail with opendir permission denied?

I am trying to make a nightly offsite backup using rsync. There is a folder /media/raid1/backup that is to be uploaded to a different server every night using a cron job running as the user ...
0
votes
0answers
198 views

rsync error: packet_write_wait

I have been trying to automate a backup script which backs up my home directory (among other things) and I have been unable to fix the error $ rsync --quiet -e ssh /home/user/bkp/user.tar.lrz user@...
0
votes
1answer
111 views

Upgrading from Ubuntu 16.04 LTS to 18.04 LTS - provisioning to restore to pre-upgrade state

We have an ubuntu 16.04 LTS server that we wish to upgrade to 18.04. However if something goes wrong, we don't want to be doing a re-install of 16.04, instead we would like to be able to take a ...
1
vote
0answers
122 views

rsync compare-dest without attributes

I'm comparing a remote folder with a local folder and only copy file differences to a new folder. This is what I use: rsync -ac --compare-dest=/folder/ rsync://remote/folder/ new-folder/ My problem ...
0
votes
1answer
68 views

rsync - on uncleaned shell and connection unexpectedly closed

I want to run rync to a remote server which has an uncleaned shell. If someone tries to connect it via ssh shell, it'll show some warnings. Due to this issue I couldn't able to copy files. protocol ...
1
vote
0answers
97 views

Is there a way to tell what bottle neck is in slow rsync transfer

I am transferring a directory from a USB hard drive to my NAS device (SMB share). USB Hard Drive performance: sudo hdparm -Tt /dev/sdb /dev/sdb: Timing cached reads: 27884 MB in 1.99 seconds = ...
0
votes
1answer
795 views

rsync unexpected remote arg: user@server:/path

I'm trying to use this rsync backup script on my server. However, I get the following error (when the script tries to execute the following command: $ rsync -ar --delete -vvv -e 'ssh -i /root/.ssh/...
0
votes
1answer
99 views

rsync not accuratenly syncing large postgres dump (~30GB)

I have a large postgres dump file (~30GB) which is being rsynced (between two Ubuntu machines, both using rsync 3.1.1, protocol v31). I'm finding that the synced file matches the correct file size ...
0
votes
0answers
49 views

rsync whole VM from Azure to AWS

I am trying to move Centos 7 machine from Azure VM to AWS EC2 instance. I have some basic understanding on Linux so i need to your help in resolving what's going on here. I am using rsync in this ...
1
vote
0answers
189 views

How to reinstall boot loader on FreeBSD?

I'm planning to use rsync to clone an entire FreeBSD server to another machine, overwriting the files of the existing old FreeBSD OS (minus /etc/hostid and a few others) But that would break the boot ...
0
votes
1answer
33 views

Sync between two servers behind seperate VPNs

Trying to rsync between two servers that are behind separate VPNs, so: Server1 <-> VPN1 <-> INTERNET <-> VPN2 <-> Server2 Is there a relatively straight forward way to accomplish this?
0
votes
1answer
37 views

I want to take backup using RSYNC and never lose in backup machine

I have my all important log files in 66 server and want to take backup in .40 server using rsync. 66 server generates log every 5hours and using rsync i want to take backup in .40 server. How can do ...
0
votes
0answers
29 views

Good way to do rsync relay for a chain of network hosts

Below is the topology of network chain I have for a content syncing job: Host1 -> Host2 -> Host3 src-folder dest-folder1 dest-folder2 I plan to use rsync ...
-2
votes
1answer
45 views

How do I include a subset of files from a directory tree with rsync?

I am backing up most of an entire volume with rsync, wanting to omit the OS X overhead files and most of the files associated with a bunch of virtual machines. Omitting the overhead files works. It's ...
0
votes
1answer
367 views

Backup with rsync painfully slow

I'm using rsync to perform backups from an NFS server hosted in AWS to another EC2 instance in the same AZ, the rsync command that I'm using in the backup server is the following: rsync -avzb --...
0
votes
1answer
167 views

Rsync with rsync daemon is not preserving owners or groups

I am setting up a new internal backup strategy where multiple hosts on my LAN will be backed up to a single host running the rsync daemon. I am still in the early stages of this, backing up a ...
2
votes
2answers
134 views

Amazon EFS as code repository for auto-scaled EC2s

tl;dr: I need to set up a fast automatic sync from EFS to multiple EC2s I've set up an EC2 Auto-Scaling Group in AWS and I'm looking for the best way to manage code deployments to my instances, with ...
1
vote
1answer
581 views

Clone a remote Linux server with rsync and migrate it locally as Virtual Machine

I have a CentOS6.9 Linux server remotely on a VPS Provider and I need to clone my remote server on my local computer as a Virtual Machine for examination purposes. I made a full server backup without ...
-1
votes
1answer
89 views

how to use Rsync to synchronize data from multiple servers to one server in a folder

I'm using GlusterFS to connect 5 servers to be a big storage, now i want to transfer the data on these 5 servers to other 5 servers and i'm thinking about use Rsync to do this. It's easier if i use ...
6
votes
4answers
435 views

Rsync huge dataset of small files 5TB, +M small files

I encountered a situation where an app server misconfig led to creation of around 5TB datasets where each dir contains huge number of small files. We are in the process of transferring the files and ...
1
vote
1answer
27 views

Sync ECC archive with non-ECC backup/archive server

For archiving and backup, I created the following strategy: Server 1 (Local Network in Office) running 24/7, Linux Ubuntu NAS on DIY Odroid XU4 with Cloudshell 2 and Raid-1 (2x 8TB) this is my ...