Rsync is a fast and extraordinarily versatile file copying tool. It can copy locally, to/from another host over any remote shell, or to/from a remote rsync daemon

learn more… | top users | synonyms

0
votes
1answer
28 views

Backup old disk to external disk (new)

One of the 2 x 500GB drives on server is crashed can read but not write the data, which both are on Hardware RAID 0. So I connected an external 1TB new drive to backup the data and replace those 2 x ...
0
votes
0answers
54 views

CENTOS 6.5 x86_64 standard rsync filling cached ram while using nocache

What I'm doing: I have mounted a windows share on my server and every five minutes I move a 1.5GB file to it using this command: nocache -n 4 rsync -a -W --bwlimit=20000 /mnt/share /file/location ...
1
vote
0answers
77 views

Mystic rsync over nfs issue - same error messages but on different files every time

When I try to backup full directories, roughly half of files are copied, other half not. All error messages are all similar - No such file or directory (2) rsync: mkstemp ...
0
votes
2answers
100 views

How to increase the disk write buffer for rsync on Mac OS X?

I have to copy some TB of data from one external drive to another (mostly ~400 MB files). The source is NTFS-formatted USB2 and the best read speed I can get from it is 7MB/s. The target is HFS+ USB3 ...
0
votes
2answers
76 views

Permissions for rsync process to access files it doesn't own withtout running it as root

I want to use rsync to take automated backups from a remote webserver over ssh. The webserver is configured with suphp, so different sites have files with different users and groups. Unfortunately a ...
1
vote
1answer
114 views

Backup with rsync and exclude

I would like to do a partial backup from a server with rsync. my exclude file looks like this bin/ boot/ dev/ initrd.img initrd.img.old lib/ my problem is now, that every lib, bin and so on folder ...
0
votes
1answer
67 views

keep a minimum free space on rsync-destination

I'm using rsync to backup two folders to the same target disk in a nightly cron-job: rsync -avz /very/important/data /Backup/VID/ rsync -avz /other/stuff /Backup/tmp/ The first job backups more ...
0
votes
0answers
57 views

Unison - Monitor and Sync Remote Directories

I have two OpenSuSE 13.2 servers. I want to sync two folders of the same name in the same location on each server. eg: /home/rocket/files/ I'd like to monitor this folder on each server for any ...
-1
votes
1answer
44 views

Two ext4 mounts, fully rsynced, same total file amount, but different total byte size. Why?

Problem We have two mount points on two disks, both are the exact same type. Both disks are formatted ext4. An rsync command with options to synchronize from source to destination is performed. ...
1
vote
1answer
80 views

Backing up Xen Guests from dom0 with disk image file

I have a Xen server dom0 with a number of guests installed and am struggling to find an easy way to manage backups from the dom0 side. Guest scripts: Of course I could run backup scripts on each of ...
0
votes
2answers
166 views

Backup remote database using mysqldump

I am trying to achieve a quick way to do a backup and download a remote mysql database to my local machine, using just the terminal. The remote server uses ssh keys for authentication. I can do it by ...
0
votes
0answers
117 views

Rsync from Ubuntu server to mounted NAS - Input/output error (5)

I am trying to rsync some backup files from a ubuntu server into a mounted NAS. All works well except for a big 13GB gz file which shows this error: rsync: close failed on ...
-1
votes
1answer
78 views

Using rsync with StrictHostKeyChecking and find files older than 5 minutes from remote

I would like to use rsync to sync my files from remote to a local directory. Therefor I use StrictHostKeyChecking so that there's no need to enter a password. Now I would like to only sync files ...
2
votes
3answers
39 views

Is it possible to have orphaned hard links?

I'm not sure if it is even possible to have an orphaned hard link. Let me explain why I'm asking. Bear with me. My Setup I am using rsync to sync my file server to my backup server. I am using the ...
1
vote
3answers
115 views

Rsync size is difference from source to destination

I'm using rsync with the options -r for recursive -l copy symlinks as symlinks -t preserve modification time -D preserve devices and specials -v verbose --prune-empty-dirs The source FS is ext4 and ...
1
vote
1answer
43 views

rsync exclude not working

I have the following rsync exclude that I am trying to run: rsync -av --exclude 'home/dir/public_html/config.text' root@remote. server.com:/home/dir/public_html/ /home/dir/public_html I have ...
3
votes
4answers
402 views

Would rsync be better than tar, wget and untar?

I am migrating to a new server and, as well as html/php files, have a directory which contains around 90,000 files totalling 24GB in size which needs to be moved. When I did a test migration, I used ...
1
vote
1answer
66 views

rsync hanging up reproducable on the same file while copying to nfs share

For the last two days I try to backup my disc to an NFS share. But after a while rsync is hanging up itself. Every time on the same file. But if I exclude the file it'll hangup on the next file. So it ...
3
votes
1answer
172 views

Slow synchronisation stage on gsutil rsync?

I've just started to use GCS as backup for my web servers. One server has 1.2 million JPEGS (3.5TB) and this all rsynced over flawlessly over 10 hours or so. The other has 2.5 million JPEGS (just ...
-2
votes
1answer
51 views

Only downloading new folders/files with rsync

I periodically run a rsync command which downloads new files from my remote server. The files that are downloaded are stored in folders, once I have downloaded them to my local machine I may delete ...
0
votes
3answers
247 views

Rsync with ssh and root not working after change hosts IP

We have a server that backup multiples servers. The backups server is located in the office and all other server in the cloud. We have moved all the server to a new IP, and from this moment the ...
1
vote
1answer
54 views

Backing up remote Ubuntu VPS via rsync — is it possible and reasonable? Any alternatives?

I have a VPS on Digitalocean. They do provide 2 ways of backup (snapshots and "regular backups"), but neither of them can be downloaded from them. My goal is to find a reasonably universal way to ...
1
vote
3answers
43 views

Different free disk space figures in df output after complete rsync -Sap transfer

I did "rsync -Sap --numeric-ids --delete-during /mnt/RAIDVault/ /mnt/RAIDVault-BACKUP/" intending to bring two storage units in sync (having identical content) but ended up with different amount of ...
0
votes
1answer
56 views

Which directories to exclude before full Ubuntu synchronization?

I have two Ubuntu server which I want to synchronize so that I can run the second server when the first server is down. I want to do the synchronization using rsync. But I read, not all the ...
0
votes
0answers
16 views

Rsync daemon : prevent the access of all a subtree except one folder by the rsyncd.conf file?

I got a Linux server on RHEL and i need to synchronize some folders from locals machines on Windows(with cygwin) and on linux via a rsync daemon on the serv. The tree are not set identically on the ...
0
votes
1answer
74 views

Start multiple rsync sessions

I want to start multiple rsync sesssions via screen in detached mode? Is it possible? I need to run rsync script for each file in folder. screen -t -d sshpass -p 123456 rsync5 rsync -avzP ...
0
votes
2answers
60 views

Migrating NFS server (Linux)

We have a NFS server (Linux) who stores files in a iSCSI disk array. This server is in production. The server and the array are very old and have to be replaced soon (the array is already in serious ...
1
vote
2answers
86 views

How to do rsync with different destination port

I'm trying to rsync between two hosts. The source host has SSH keys in the destination server and I verified it can ssh without a password. The destination server is allowing ssh over port 2209. When ...
0
votes
2answers
63 views

Moving files between hosts using intermediate storage area [closed]

Is there any good existing solution for moving files from host A to host C, using host B a an passive intermediate storage area. A -> B -> C Limitations Host A and host C are on separate networks ...
-1
votes
1answer
33 views

rsync - file is 8 bytes larger on recipient

I have a file that I have tried transferring across the wired LAN via both scp and rsync, and both have yielded the same result. When I run du file on the file after the transfer, the file is 8 bytes ...
0
votes
1answer
71 views

Rsync - Setting up rsync user and his permissions

I will be setting rsync between two webserver. I am aiming to have backup of data from my primary server on the secoundary in case if primary server crashes. My question relates to setting up on ...
62
votes
3answers
4k views

Rsync triggered Linux OOM killer on a single 50 GB file

I have a single 50 GB file on server_A, and I'm copying it to server_B. I run server_A$ rsync --partial --progress --inplace --append-verify 50GB_file root@server_B:50GB_file Server_B has ...
0
votes
2answers
66 views

rsync: how to exclude folders/files in destination from being deleted

I've read several threads on this issue, but the commands stated there didn't work for me still. I'm trying to rsync files from folder1 (containing sub-folder a ) to folder2 (containing a and b ) ...
0
votes
1answer
800 views

OpenMediaVault and RSync - SSH Key authentication

I installed an OpenMediaVault server. This server allows to configure some rsync pullings. I'd like to pull some data from another server to my OMV server with rsync. Let's call my OMV server the ...
0
votes
0answers
70 views

Asynchronous file replication over WAN

I need to keep in sync the same directory on 2 linux servers in separate datacenters. The directory contains a lot of user data such as pictures, html, zip, pdf, doc etc. The data size is growing, ...
0
votes
2answers
33 views

Recover files from a failed RAID 1 - How do I rsync if source file size is bigger

I have 2 drives that were on a mirrored RAID. The server crashed (failed array) and there are no backups. The client was setup with Carbonite, but failed to renew their plan, which expired this past ...
0
votes
0answers
58 views

rsync incremental file list taking forever

I'm copying from one NAS to another. (Netgear ReadyNAS -> QNAP) i tried Pulling the files by running rsync on the QNAP, and that took forever, so I'm currently trying to push them from the Netgear. ...
0
votes
2answers
231 views

What is the best way to sync 2 identical centos servers in real time

I am operating a centos linux server(A) and I want to create a realtime backup server(B) so whenever server A goes down server B(after the failover kicks in) will take over. I already solved the ...
0
votes
1answer
85 views

What are the benefits of configuring rsync with rsync shares vs. without?

I know there are two or more methods of working with rsync: The first one requires that rsync would be installed on the destination machine and then you can run something like that: rsync -avz file ...
0
votes
0answers
54 views

What is the recommended backup strategy for GlusterFS?

I have about 1M files in a GlusterFS with rep 2 on 3 nodes. What would be a recommended automated backup strategy for this setup? I already considered the following: 1) glusterfs snapshots in ...
0
votes
1answer
755 views

Ansible synchronize hangs when executing inside ssh with delegate_to

The following task works fine when run directly from my machine. When I run it from a remote machine through SSH it hangs forever. This is the task: - name: deploy public directory ...
0
votes
1answer
58 views

Why is glusterfs renaming files during rsync import?

While searching for an error after failed initial rsync of data to glusterfs I found the following entry in /var/log/glusterfs/data-nfs.log: [MSGID: 109066] [dht-rename.c:1410:dht_rename] ...
1
vote
0answers
139 views

rsync crashes machine while performing sync on glusterfs mounted share

I am running ubuntu 14.04 as guest inside virtualbox 5.0.3 on OS X. While performing rsync on a glusterfs (3.7.x) mounted share with over 100.000 files, the entire machine crashes. There is one ...
1
vote
3answers
249 views

How to transfer data between s3 buckets of the different aws account using command line

How to transfer data between s3 buckets of the different aws account using s3cmd ? command will be like this: s3cmd rsync s3://acc1_bucket/folder/ s3://acc2_bucket/folder --recursive But then how ...
2
votes
2answers
45 views

Linux: Detecting/thwarting system modification or use of single user mode

Working through a backup solution and could use some security assistance. Please see below. The process For our editing business, we have an offsite backup server that we update nightly using rsync ...
0
votes
0answers
105 views

rsync: Exclude all, include some and exclude sub-dirs

In the past I had a couple of scripts that used rsync to sync a lot of stuff from remote locations to a local HD. I had it setup in the way that, I created a excluded.txt and included.txt file for ...
2
votes
1answer
66 views

passing additional parameters to rsync using rsnapshot

I have my backups being performed by rsnapshot, works well. EXCEPT, on one of the jobs for the /home volume I'd like rsync to copy the sym-links as physical directory/files. I believe the parameter ...
0
votes
1answer
426 views

Rsync shell script permission error on destination server

So this is my first bash script attempt, and I am trying to rsync a project folder on OS X to a development server running ubuntu 14.04. I get some permission errors on the destination server when I ...
0
votes
1answer
54 views

sporadically, rsync takes exceptionally long

We do backups with rsync like this: rsync -axH --inplace --delete --delete-excluded \ --exclude-from=excludes --stats \ --link-dest="${previous?}" "${source?}"/ "${dest?}"/"${stamp?}" $previous ...
1
vote
2answers
62 views

How to prevent rsync from chown'ing remote users files

I'm doing rsync /local/path/to/src user1@remote:/path/to/dest. dest belongs to user2@remote. How do I keep rsync from chown'ing dest to user1 after syncing? Please note that I have already tried ...