Rsync is a fast and extraordinarily versatile file copying tool. It can copy locally, to/from another host over any remote shell, or to/from a remote rsync daemon

learn more… | top users | synonyms

-1
votes
1answer
14 views

rsync to remote ssh or to local iscsi

I'm curious of anyone knows a link to or can elaborate upon this design question: I have a server that I would like to make a backup copy of data from. I have a second server that is iscsi-enabled. ...
2
votes
1answer
3k views

rsync unexplained error & received SIGINT, SIGTERM, or SIGHUP

I created a batch script to back-up our server: #!/bin/bash user=$1 # create user dir ssh root@local.backup.tst -p 5774 mkdir -p /var/backup/server.tst/incremental/$user # backup mail dir rsync -...
2
votes
1answer
1k views

Synology NAS - rsync messing up versioning / deduplication

Is it true that Synology DSM 4.3's default rsync implementation is not able to handle "vast" amounts of data and could mess up versioning / deduplication? Could it be that any of the variables (see ...
0
votes
0answers
37 views

Can rsync be used to upgrade operating systems?

I have two identical hard disks (say HDD1 and HDD2) with 4TB capacities. I want to create install CentOS, update it, install services and create users on one of the hard disk, say HDD1. Now if I ...
0
votes
1answer
18 views

How does rsync with daemon works?

I'm trying to sync files from a source machine to a destination machine in the same local network. These machines have less cpu speed. As far as I read in some domcumentations ist that rsync with ...
5
votes
0answers
42 views

Can you scp, sftp, or rsync, a pipe? [migrated]

I want to tar and send a ~700GiB directory to a remote drive I don't control. I don't have the HDD space locally to create the tarball and then copy that over. The remote is also protected by rssh - ...
4
votes
2answers
1k views

Copy files from guest to host the first time with rsync using Vagrant

When doing vagrant up a "shell" provision download some files into the synced folder. Those files should be also copied to the host machine synced folder, so that the project would be available from ...
0
votes
1answer
2k views

Rsync hangs when transfering large files on an bad connection

've been having problems transferring files over a pretty bad connection (I'm trying to upload a file on a cloud server) via rsync. The rsync essentially hangs after about a minute or so. This is the ...
0
votes
1answer
28 views

rsync to backup a multi-user NAS

The setup : a Ubuntu server with samba shares to 25 users all with Windows (different locales). the Ubuntu server then has a daily cron job executed as Admin (not root) running rsync to backup the ...
4
votes
0answers
63 views

How to re-compile iconv on Linux (Ubuntu 14.04 LTS) with pseudo-charset UTF8-MAC?

I was googling around for hours to find a solution for my problem and I couldn't get it to work: I have to rsync a file structure on an ext4 formatted drive to a hfs+ formatted drive. Folders and ...
2
votes
3answers
2k views

Rsync hangs: expand file_list pointer array to N bytes, did move

Rsync is going into "interruptible sleep" mode after transferring some files from a local folder to a NFS folder. The folder I am trying to backup contains more than 180gb of data. This is what rsync ...
0
votes
1answer
28 views

Rsync with ssh, job fails: Permission denied (13)

Recently my rsync job has been failing with the error shown below: rsync: mkstemp "/foo/bar.txt" failed: Permission denied (13) inflate returned -3 (0 bytes) rsync error: error in rsync protocol data ...
-1
votes
0answers
16 views

Why would rsync be limiting syncs to ~252Kilobytes?

Here's a head scratcher for you... or at least it is for me. I am transferring a Wordpress site away from WP Engine to an Amazon instance. I am trying to upload the original Wordpress files from my ...
0
votes
2answers
42 views

Backup laptop and server folder using rsync

I want to have a folder in my laptop synched in the server. My purpose is to have 'cloned' folder in laptop and server. Both folders will be updated when changing files either in laptop or server with ...
0
votes
0answers
26 views

'rsync -av −−del' gives error

Seems --del has problems with permissions. I don't know what's happening but rsync is not deleting file '1-s2.0-S1369527414001830-main.pdf' on local. rsync -av −−del /home/bernardo/...
0
votes
2answers
47 views

RSYNC from an External Hard drive

I want to use RSYNC for the incremental copy of a folder which has a considerable size. The source (a directory) resides on an External hard disk (as we cannot have a network link between the source ...
2
votes
1answer
47 views

SSH works both ways, but scp and rsync only one way

I have been using SCP and rsync to transfer some files between two servers using SSH keys. Suddently SCP and rsync don't work anymore from server 1 to server 2. They don't give any error or ...
0
votes
1answer
2k views

rsync error on Downloading

I am trying to setup a Rsyncmirror on my mount drive /mnt/Mirror/ubuntu_mirror, so I am trying the command: rsync -a --bwlimit=128 rsync://archive.ubuntu.com/ubuntu /mnt/Mirror/ubuntu_mirror but it ...
0
votes
1answer
68 views

rsync/scp extremely slow transfer rate (<30kB/s) over fast connection

I am attempting to perform a backup using rsync of some files on a Digital Ocean VPS running Ubuntu 14.04.4 LTS. rsync is extremely slow, ranging from 20-50 kB/s, only 1% of what it should be. It is ...
1
vote
6answers
3k views

Rsync / Sqlite database

Does anyone have ever tried rsync'ing sqlite database? Is it possible to access the data while it gets syncronised?
0
votes
1answer
11 views

Rsync hard-links when modification times are different

I have a large remote directory A and local directory B that are nearly identical in content, though many of the modification times may have changed by copying files etc. I want to create a local ...
1
vote
2answers
1k views

s3fs Input/output error

I'm trying to set up a backup system with s3fs and the Amazon S3 service. I followed this this guide and this guide. Tailing /var/log/messages I get: Aug 28 13:37:46 server s3fs:###response=403 I ...
3
votes
1answer
2k views

easy way to restore incremental rsync backup?

I have incremental rsync backups of a folder, created with: rsync --delete -a -v --backup --backup-dir="../backup_`date +%Y-%m-%d`" /orig /backups/dest so I have a copy of current /orig on /backups/...
8
votes
3answers
4k views

Get list of transferred files from rsync?

I'm currently using rsync on a script that deploys a PHP application from a staging to a production server. Here is how: rsync -rzai --progress --stats --ignore-times --checksum /tmp/app_export/ root@...
0
votes
3answers
151 views

Permissions for rsync process to access files it doesn't own withtout running it as root

I want to use rsync to take automated backups from a remote webserver over ssh. The webserver is configured with suphp, so different sites have files with different users and groups. Unfortunately a ...
0
votes
1answer
34 views

rsync: connection unexpectedly closed - No tty present

I'm having issues trying to rsync files over from a build server to a web server. the command im running is rsync -e "ssh -i ${HOME}/.ssh/id_rsa" --rsync-path="sudo rsync" -avh --chown=nobody:webdev ...
0
votes
2answers
21 views

Inotify & Rsync - Don't move files before download is completed

I am using a local website which downloads files to my server. Using an Inotify daemon I'm listening for file changes in a specific folder (the one I am downloading to) and executing a script which ...
2
votes
2answers
912 views

Install rsync on VMware ESX 4.1 server

I have a Red Hat Enterprise Linux Server release 5.1 (Tikanga) VMware ESX 4.1 (Kandinsky), and my plan is to backup the files from the box to a NAS in another host. I have already resolve the ssh ...
0
votes
3answers
982 views

rsync: ssh unknown option -p2122

I run this command to replicate data from one server to another. It's been working for a quite a while. I have this setup as a cron job. Yesterday for some reason, it stopped working. I ran it ...
0
votes
2answers
32 views

Rsync to remote server and change file / directory ownerships

I am using Rsync to deploy to a remote server, which is working. However the file and directory ownership always replaces old files with root:root I need the ownership of all files and folders ...
0
votes
1answer
35 views

rsync: no lockfile created on system reboot

After system reboot rsync starts but no lock file is created, therefore when rsync on a remote machine tries to get a directory for backup it fails with @ERROR: failed to open lock file rsync error: ...
0
votes
1answer
46 views

NFS drive full even though du says it's not [closed]

I am experiencing a very weird behaviour of my backup drive that I can neither explain nor get fixed. I have an external drive mounted via NFS. I regularly call rsync jobs that backup files from my ...
2
votes
2answers
121 views

Install rsync 3.1.1 on systemd

I have CentOS 7 and it comes with Rsync 3.0.9. I downloaded the 3.1.1 el7 rpm and installed with rpm -Uvh. Now the daemon refuse to start. I tried to create : /usr/lib/systemd/system/rsyncd....
6
votes
3answers
8k views

Rsync fails to backup some files, giving error 22

I'm trying to backup my whole server using a simple rsync on a NFS mounted volume on '/nas' Here's my rsync command rsync -sav -S --stats -H --numeric-ids --delete -D --exclude-from="/usr/local/...
2
votes
2answers
29 views

rsync: ignore files in use (being written to)

I have an SFTP server where clients are constantly uploading large files. On a periodic basis, I want to copy all complete (fully uploaded) files to another machine for processing. I don't want to ...
0
votes
2answers
119 views

why does 'rsync --delete-before' delete files from target that still exist at the source?

I have a centOS 7.1 linux box with rsync 3.1.1. There are files there that I want to transfer to a FreeNAS 9.10 machine. For this I've set up an rsync daemon on freeNAS and transferring files works ...
97
votes
16answers
89k views

Showing total progress in rsync: is it possible?

I have searched for this option already, but have only found solutions that involve custom patching. The fact that it does not show in --help and no more info can be found probably indicates the ...
-1
votes
2answers
42 views

Script to delete older files and copy what is left

We have a server that runs an application that is used internally. The application has a utility that creates its own backups every 24 hours. Backups are stored in: /var/application/application-data/...
1
vote
0answers
55 views

Can't access folders created by rsync on qnap server

I'm trying to use RSync to backup my files to my QNap Turbo Nas. I have activated the rsync service and created a private shared folder named "RSync". On my Windows machine I mapped a network drive ...
6
votes
6answers
8k views

Rsync Remote to Remote

I'm looking for a solution for using rsync between 2 remote servers. It seems like its not possible. Does any one know why its not possible? I ask that because I think if I know the reason, maybe I ...
2
votes
2answers
467 views

Cobbler import failing

I've been playing with Cobbler lately (on a CentOS 7 distrib), and I've gone through an error while importing a CentOS 7 iso. I've been able to find a work around to the problem, and I thought it'd be ...
4
votes
1answer
83 views

Rsync takes 8+ hours to backup 15M+ files

I have ~700GB storage where I store ~15M files, hence average file size is ~50KB. To back it up, over night I run a simple rsync script with the following set of flags: --archive --update --compress -...
1
vote
0answers
20 views

rsync: Maximum nice to keep system responsive

Unfortunately a background rsync reduces the responsiveness of a server. I search a way to have maximum niceness for this background task, to keep the server respond fast. My current wrapper ...
-1
votes
2answers
106 views

Full system backup with rsync

I was reading this article about how to do a full system backup using rsync. This article assumes you have another machine with a similar linux system. What if is not the case? How different would be ...
1
vote
0answers
65 views

How to create image file and mount via. loopback (Ubuntu to remote backup space)

I've been fiddling around with the Hetzner Backup Space and I want to use rsync via. rsnapshot in order to back up my files (more info at their Wiki here) They state in their documentation: The ...
1
vote
1answer
55 views

rsync - exclude all directories except a few

There appear to be a lot of SF and SO questions out there about this, but none seem to match my requirements. source_dir/ some_dir/ another_dir/ some_file.php some_other_file.txt ...
0
votes
0answers
21 views

Rsync help: upload files with changed ones renamed?

I hope someone can help me with rsync. I have a large directory with many (thousands) subdirectories, in which I sometimes mirror (individually download) files from a remote site to work on them ...
0
votes
0answers
31 views

Rsync backup to veracrypt-encrypted USB memory stick results in errors

I have created encrypted USB memory stick using Veracrypt for backup. First sync went ok, now trying to update it results in error. I'm using this command after mounting the volume: sudo rsync -...
0
votes
1answer
27 views

Does rsync -H convert file to hard link on destination after deduplication on source?

I've got two servers, the second one being synced via rsync every now and then. I've got some (few thousands ?) of big duplicate files on which I would like to use freedup to spare some space. If I ...