Stack Exchange Network

Stack Exchange network consists of 174 Q&A communities including Stack Overflow, the largest, most trusted online community for developers to learn, share their knowledge, and build their careers.

Visit Stack Exchange

Questions tagged [rsync]

Rsync is a fast and extraordinarily versatile file copying tool. It can copy locally, to/from another host over any remote shell, or to/from a remote rsync daemon

0
votes
1answer
12 views

rsync control server-side which files are getting synchronized

I am trying to backup full server. I do not want paths like /proc and sys for instance. Here is my /etc/rsyncd.conf file : uid = 0 gid = 0 use chroot = true read only = true hosts allow = 10.11.12.13 ...
3
votes
1answer
16 views

BackupPC RSync job timing out

I have a BackupPC RSync job that is not completing on a new server. The job just times out after signal ALRM. I increased the time out to 288000, but it will still time out and doesn't appear to ever ...
1
vote
0answers
14 views

rsync to report file size using `--out-format`

I would like rsync to report the file size at the source location for all files being reported when I use --itemize-changes or --out-format. For example, I know I can use the following format, "%i %f",...
7
votes
3answers
123 views

How to make rsync of ~2M files from remote server performant for regular backups

We have a large amount of files on a remote server that I'd like to setup regular backups to a local system for extra redundancy. Some details: Remote system is not in my control. I only have SSH/...
0
votes
1answer
51 views

Why does rsync sometimes fail to overwrite my local files?

I have a script called copy-site which I use to copy a site from the production server to my local machine. copy-site example.net/httpdocs/ example.local/httpdocs/ will do a dry run rsync; adding a ...
0
votes
0answers
20 views

What does rsync status code 3072 mean?

I'm using the static site generator Nanoc, with rsync locally and on the (ancient Ubuntu) server so I can deploy from the command line. It's been awhile since I last used rsync for this site but I'm ...
0
votes
0answers
27 views

rsync fails on network drive after file edits

I have a directory on a Linux server that gets rsync'd to a location on a network share drive (NFS?), which is accessible by Windows desktop users; rsync -vrthP /server/dir /network/dir A user ...
0
votes
0answers
16 views

Weird log output from rsnapshot

I am using rsync on my low-power NAS to backup my server to it. I just found this warning in the logs, which I do not understand: [08/Jan/2019:23:43:04] /usr/bin/rsnapshot -c /etc/rsnapshot.conf ...
1
vote
1answer
49 views

Rsync on mounted google drive [closed]

I have mounted my google drive in ubuntu nad want to rsync my pictures. I issue the command rsync -Parvhz folder1 /home/me/GoogleDrive/Pictures/ it transfer them all. Then I re-issue the command ...
1
vote
1answer
45 views

Can't mount ntfs drive anymore ($VOLUME_INFORMATION attribute not found in $Volume)

I have a external hard drive with ntfs partition and it isn't accessible or mountable anymore. Last thing I did was a rsync copy to that usb drive. I still can see the ntfs partition with gnome-disks ...
1
vote
1answer
51 views

Clever way to reduce rsync/rclone load with backups to Amazon S3?

I started running rclone to keep a set of files on my laptop that are synced up to the cloud and encrypted. I wanted to 'control' the encryption because of trust issues. Rclone does this pretty well, ...
0
votes
0answers
19 views

Creating a mirror directory structure with just a list of files

I know the rsync tool and I have studied this post, but I cannot do this: I have ~/Documents/src/ directory which has many sub-directories and files. I need to create ~/Documents/des/ directory which ...
0
votes
1answer
19 views

Can `path` in rsyncd.conf be a file?

I would like to only allow /etc/named.conf to be synced, so if I in etc/rsyncd.conf do [named] path = /etc/named.conf and then # OPTS='-aHEXv --password-file=/etc/rsync.secrets' # rsync $OPTS ...
-1
votes
1answer
166 views

Linux server fails file copy over 2.0 GB

When using RSYNC, CP or DD on Linux to a Windows SMB share the file gets to 2.0 GB of 6.3 GB and errors stating file is too large. This has started since disabling SMB1 on the Windows share. I ...
0
votes
1answer
61 views

Did my rsync successfully back-up all data or not?

It looks like not a single byte is missing after the rsync, but there were some errors: ujjain@DS3018xs:/volume1$ cat rsync.sh rsync -av photo.tar /var/services/homes/ujjain/nfs/RAIDF1/ rsync -av ...
1
vote
0answers
84 views

rsync --link-dest. Time to 'building file list" incrementing

I've been running rsync as a cygwin task on Windows Server 2008 for about two months now. I'm using the --link-dest option to do a daily 'snapshot' of the contents of a server containing about 10TB ...
0
votes
0answers
183 views

Remote incremental backups with rsync?

I'm trying to set up rsync to send incremental backups to a remote server. The first backup would go to a "backup" folder, then the next backup would send only the changes to a "backup.1" folder, and ...
0
votes
1answer
27 views

exclude/include rules of rsync

I need to include in rsync rules only .local/shares/ no other directory in .local/ and exclude certain directories from /.local/shares. My rules are currently as such: + /.local/share/ + /.local/...
1
vote
1answer
69 views

ZFS pool size discrepancy after rsync-ing

I am trying to rsync data one of the volumes in a ZFS pool to an exfat formatted drive. The volume is only 1.3 TB but the rsync got up to syncing 3+ TB worth of data. I killed the rsync so I could ...
3
votes
1answer
29 views

rsync -av -e “ssh”, plus a bunch of “includes” with an ending “exclude='*''”, not copying all files

An rsync command that looks like of like this, rsync -av -e "ssh" --include="dir1" --include="dir2" --include="dir3" --include="file1" --include="file2" --include="file3" --exclude="*" user@server:/...
1
vote
2answers
76 views

rsync ignores --chown/--usermap

I'm running ansible with the synchronize module, which underneath runs rsync. My problem is not ansible-related, as I took the rsync command from the debug output and ran it manually - still the same ...
1
vote
1answer
68 views

ssh login passwdless works,but rsync not on Centos7

I want to backup server files automatically,so I try to do it with rsync. I use below command to ssh login passwordless. ssk-keygen ssh-copy-id root@ss1.xxxxx100.com ssh-copy-id backup@ss1.xxxx100....
0
votes
0answers
31 views

rsync + find & replace string on all incoming files

I am using rsync to sync my development server with my production server. To make things easier, how can I pipe all the files so that all instances of a string are replaced with another during the ...
1
vote
2answers
60 views

Advices for 1.5m files syncing with rsync

I have a folder with about 1.5 million files and I need them to be copied to a secondary server as often as possible. What would you recommend because clearly standard rsync commands do not make it ...
0
votes
1answer
64 views

Auto backup and delete a project directory using cronjob

I am trying to backup a directory, location: /mnt/project/ once in 24 hrs, and another directory inside the parent directory, location: /mnt/project/uploadDocuments/ every 3 hours using cronjob. ...
0
votes
2answers
91 views

Call rsync with args stored in a string

This is the same script as the one cited in my mhddfs thread, I'd like to define the args according to some inputs, and call rasync afterwards. I currently came up with this but only the call to rsync ...
0
votes
1answer
87 views

CentOS 7 - systemctl - chown - unexpected remote arg

I have a custom made service file and I'm unable to run it. Here is the ExecStart line: ExecStart=/bin/rsync --ignore-existing -rtvu /var/foo/foo/ /var/foo2/foo2 && /bin/chown nginx:nginx -R /...
2
votes
1answer
651 views

Issue running rsync from windows server 2016 to windows server 2016

I'm trying without success to copy files from one windows host to another using either cygwin or powershell and the rsync.exe. On the windows host I want to send the copy I have openssh installed, I ...
2
votes
1answer
95 views

rsync file size discrepancies [duplicate]

I have a few PC's with an ext4 filesystem that I want to backup to a file server which is also ext4. Problem is there are some discrepancies in file sizes when using rsync, and I have noticed this is ...
2
votes
1answer
76 views

High availability mirroring without separate partitions or LVM on Ubuntu 14.04 LTS

I'm on AWS with my clients for a long time now but I'm going to need cut costs now to keep providing my services. On AWS I'm using RSync to keep some folders synchronized and DRDB to provide high ...
0
votes
1answer
40 views

rsync not working after revoking public access aws ec2 instance

I have a setup where I need to copy a files from 1 ec2 instance to another instance using rsync, I used following command which worked fine rsync -ave 'ssh -i certs/cert.pem' /var/www/html/uploads/...
0
votes
0answers
24 views

NAS with DVD.ISO Images won't rsync

I have 2 NAS servers (Freenas). One is set up only to be a backup of the other. I have rsync working through the interface and it works for other files. My DVD.ISO images will not rsync. I'm not ...
-2
votes
1answer
2k views

rsync error: error in rsync protocol data stream (code 12) at io.c(600) [sender=3.0.6]

Recently I have been unable to rsync over ssh. Each time I get the same error bash: rsync: command not found rsync: connection unexpectedly closed (0 bytes received so far) [sender] rsync error: ...
0
votes
0answers
349 views

How to use rclone to sync with s3 and acl public-read

Ref: Rsync to AWS S3 bucket A reply to the above question suggests using rclone in a similar way to rsync. It seems like it might work, but it doesn't seem to use the ACL I want. Previously, I use ...
0
votes
1answer
343 views

Host Key verification failed SSH Rsync

Two days ago I started using SSH to transfer backups of two Linux servers to another one. I created a shell script to run it in Crontab. Both servers are using Ubuntu 14.04.5 LTS My SQL-Server ...
0
votes
1answer
119 views

how to create fake symlinks when copying to CIFS share with rsync

So I have to backup lot's of data to a company server. And it creates a fair share of symbolic links. I'm on a Linux Machine, and the backup server is accessed via CIFS, which does not support ...
0
votes
1answer
203 views

How to show rsync speedup

Rsync used to show an overall speedup score when the command was completed. There is even reference to the speedup value on the manpage in the --dry-run option, but it seems to have otherwise ...
0
votes
1answer
232 views

Why does rsync+cron fail with opendir permission denied?

I am trying to make a nightly offsite backup using rsync. There is a folder /media/raid1/backup that is to be uploaded to a different server every night using a cron job running as the user ...
0
votes
0answers
232 views

rsync error: packet_write_wait

I have been trying to automate a backup script which backs up my home directory (among other things) and I have been unable to fix the error $ rsync --quiet -e ssh /home/user/bkp/user.tar.lrz user@...
0
votes
1answer
126 views

Upgrading from Ubuntu 16.04 LTS to 18.04 LTS - provisioning to restore to pre-upgrade state

We have an ubuntu 16.04 LTS server that we wish to upgrade to 18.04. However if something goes wrong, we don't want to be doing a re-install of 16.04, instead we would like to be able to take a ...
1
vote
0answers
154 views

rsync compare-dest without attributes

I'm comparing a remote folder with a local folder and only copy file differences to a new folder. This is what I use: rsync -ac --compare-dest=/folder/ rsync://remote/folder/ new-folder/ My problem ...
0
votes
1answer
86 views

rsync - on uncleaned shell and connection unexpectedly closed

I want to run rync to a remote server which has an uncleaned shell. If someone tries to connect it via ssh shell, it'll show some warnings. Due to this issue I couldn't able to copy files. protocol ...
1
vote
0answers
215 views

Is there a way to tell what bottle neck is in slow rsync transfer

I am transferring a directory from a USB hard drive to my NAS device (SMB share). USB Hard Drive performance: sudo hdparm -Tt /dev/sdb /dev/sdb: Timing cached reads: 27884 MB in 1.99 seconds = ...
0
votes
1answer
1k views

rsync unexpected remote arg: user@server:/path

I'm trying to use this rsync backup script on my server. However, I get the following error (when the script tries to execute the following command: $ rsync -ar --delete -vvv -e 'ssh -i /root/.ssh/...
0
votes
1answer
159 views

rsync not accuratenly syncing large postgres dump (~30GB)

I have a large postgres dump file (~30GB) which is being rsynced (between two Ubuntu machines, both using rsync 3.1.1, protocol v31). I'm finding that the synced file matches the correct file size ...
0
votes
0answers
57 views

rsync whole VM from Azure to AWS

I am trying to move Centos 7 machine from Azure VM to AWS EC2 instance. I have some basic understanding on Linux so i need to your help in resolving what's going on here. I am using rsync in this ...
1
vote
0answers
247 views

How to reinstall boot loader on FreeBSD?

I'm planning to use rsync to clone an entire FreeBSD server to another machine, overwriting the files of the existing old FreeBSD OS (minus /etc/hostid and a few others) But that would break the boot ...
0
votes
1answer
36 views

Sync between two servers behind seperate VPNs

Trying to rsync between two servers that are behind separate VPNs, so: Server1 <-> VPN1 <-> INTERNET <-> VPN2 <-> Server2 Is there a relatively straight forward way to accomplish this?
0
votes
1answer
38 views

I want to take backup using RSYNC and never lose in backup machine

I have my all important log files in 66 server and want to take backup in .40 server using rsync. 66 server generates log every 5hours and using rsync i want to take backup in .40 server. How can do ...
0
votes
0answers
50 views

Good way to do rsync relay for a chain of network hosts

Below is the topology of network chain I have for a content syncing job: Host1 -> Host2 -> Host3 src-folder dest-folder1 dest-folder2 I plan to use rsync ...