Rsync is a fast and extraordinarily versatile file copying tool. It can copy locally, to/from another host over any remote shell, or to/from a remote rsync daemon

learn more… | top users | synonyms

0
votes
1answer
103 views

rsync with --backup

I'm trying to rsync a single directory of files and store timestamped revisions at the destination. This is what I'm using at the moment: rsync --verbose --progress --stats --compress --no-whole-file ...
-2
votes
2answers
416 views

How to make rsync delete destination directories no longer existing at source? [closed]

I have hard drive that I back up with rsync to a network-attached storage. There are some non-empty directories at the destination (the nas) that do not exist on the source anymore. It is not a ...
1
vote
1answer
108 views

What rsync options to use for the below mentioned scenario?

Greetings !!! This is regarding a specific requirement about rsync that we are trying to achieve. We have tried to achieve this by using various rsync options. However, we are encountering different ...
0
votes
0answers
35 views

backing up millions of files and 1 tb [duplicate]

I'm trying to find a fast solution that can transfer about 3 million files taking up about 1tb of space. So far after a bit of research my choices seem to be lftp and rsync. Which option would work ...
0
votes
1answer
46 views

Maintaining rsync log file

I have a cron running rsync for backup purposes, and rsync logs the output to a file via --log-file. This script will keep on running for a quite long time and I am worried that the log file will keep ...
0
votes
3answers
2k views

rsync : write failed - No space left on device (28)

I want to rsync a folder from one server to another. But rsync synchronization fails: $ rsync -zr --compress-level=9 --delete /var/www/mywebsite/current/web/js login@192.168.1.4:/srv/data2_http ...
2
votes
1answer
1k views

sync millions of files with rsync and inotify

I just think of one scenario when using rsync and inotify to sync millions of files. Assume I have 1 million files to sync to another server and the file list may has 20M size. When I just add one ...
0
votes
1answer
55 views

rsync snapshots backup when process is running [closed]

I have a directory which I wish to backup. However, a process is constantly writing to files in that directory and I cannot shut down this process, do the backup and restart the process. The backup ...
0
votes
1answer
128 views

Pulling Read restricted files from a remote system with rsync and sudo

A remote system generates statistics files every 5 minutes and places them in a certain directory. At any given time there are 1000+ files in that directory. Every 5 minutes I want to copy the ...
0
votes
1answer
76 views

Freshly cloned mirrored drive with Acronis true image and rsync wrongly detects changed files, windows rsync 3.0.7 cygwin windows

Is there a way to help rsync better detect that files are identical? I did a fresh full disk "clone" mirror with Acronis TrueImage and after did an rsync to test and it detected a bunch of files as ...
1
vote
0answers
81 views

Ubuntu 14.04 - rsync corrupting SSH configs/keys?

I have two Ubuntu 14.04 servers S1 (user root) and S2 (user dataman). S1 is responsible for handling file uploads and transferring backups to S2. On S1 I am using PubKey authentication to S2 for ...
1
vote
1answer
72 views

Using Unison / rsync over SSH to synchronize sites where full file system access is required yet root login is disabled

Assume two sites A and B with file server at either end. The contents of /storage should be synchronized between the sites, preserving ownership and permissions. There's no all encompassing group that ...
-1
votes
1answer
31 views

Pushing file to server more efficiently [closed]

I have a cluster of daemon running on Mac that generate a lot of jpg in a folder like this content/categoryname. The category name is considered as unique across multiple machine. So what is the ...
1
vote
1answer
195 views

Can rsync ignore a directory's atime entry when creating it's file list?

I am using rsync to copy data from a local LVM drive to a locally-mounted glusterfs mount. I'm trying to bring them in to sync and eventually cut over to just using the glusterfs mount. Here is the ...
1
vote
3answers
48 views

rsync for backup but don't want to wipe ( not erase ) drive

I am not sure how to even ask this question without explaining. Say I use rsync to backup drive-a to drive-b. Drive-a fails and all data is lost when the rsync went off it saw that drive-a had been ...
2
votes
0answers
251 views

Fastest ways to do backups: FTP, rsync, Robocopy, SMB/CIFS, etc? [closed]

Im looking for methods to do (incremental) backups and sync from and to NAS over LAN and VPN. Im having trouble finding couple implementations between Linux and Windows. My Linux NAS boxes have ...
1
vote
0answers
64 views

Two allowed paths in rsync command in authorized_keys

I have a question about rsync restriction in authorized_keys command. I need to copy files via rsync from one server to another without prompting password. There is no problem, but I need to specify ...
2
votes
1answer
141 views

Issue connecting SSH after using rsync

Before using rsync to copy files from local to remote I was able to do passwordless login to the remote host using ssh. This always worked: $ ssh domaster Then I used rsync and everything was fine, ...
3
votes
1answer
23 views

How to copy a directory of files before a particular service starts up on Windows 7

I have a Windows 7 desktop and a Linux server running SSH and Samba services. The Windows machine has a directory of files that need to be synced with a copy on the Linux server. The Windows machine ...
0
votes
2answers
904 views

Is it better to use rsync over SSHFS or over CIFS as remote repository, having no option for rsyncd?

I have a NAS that is only capable of CIFS, AFS, SSH (no rsyncd capabilities, no NFS). I have to backup very large files (vm images) and I usually set a rsync server on the backup device then I do a ...
3
votes
0answers
1k views

vagrant ssh - asks for password after adding synced_folder

I can vagrant ssh into my box fine Welcome to Ubuntu 14.04.2 LTS (GNU/Linux 3.16.0-30-generic x86_64) * Documentation: https://help.ubuntu.com/ Last login: Mon Apr 13 13:05:26 2015 from 10.0.2.2 ...
0
votes
1answer
187 views

rsync windows active directory deployment

Is there any tool that let me do a massive rsync installation through Active Directory for windows machines??, I was searching but i do not find anything... until now. I am looking for something like ...
1
vote
1answer
120 views

RSync incremental backups, backing files that haven't changed. Does file access time cause a re-backup? [duplicate]

I backup my LAMP server using RSync over SSH. Currently, it's on an hourly incremental schedule. From a 14GB full backup, it's backing up a further 15~MB hourly. Looking at the files it's backing ...
1
vote
1answer
2k views

Backing up Zimbra 8.0.x, data.mdb issues

When trying to create a backup of zimbra open source edition 8.0.1+ I ran into issues with data.mdb 'exploding'. While my /opt/zimbra directory is only about 8GB my backup is around 80GB. both rsync ...
-1
votes
2answers
112 views

Compress whole directory with rsync and upload to remote

I know I can go like: rsync -zaP uploads/ myserver:/path/to/ If I understand right, that will compress each file in that directory and sync one by one to the server. But if it's thousands of files, ...
0
votes
1answer
77 views

Rsync : copying over timestamps only by filename

I'm trying to do almost the same in this question: Rsync : copying over timestamps only But in this case, some os the files were already modified... There is any way to change just the timestamp ...
2
votes
1answer
124 views

rsnapshot Freezes when Backing up to NFS Mount

I've got a Server running Ubuntu Server 14.04 server that has been doing periodic back-ups to an NFS mounted NAS using rsnapshot for several months now without issue. Last week we added a few more ...
3
votes
1answer
738 views

How do I check if a backup by rsync is successful?

I use rsync -a to do a full backup on a file system. Its output to stderr is empty. Shall I do some additional checking to verify if the backup is successful? For example, how can I do a checksum to ...
3
votes
0answers
126 views

Solution for file data backup, versioning and replication

We have a growing set of data files (.wav files, image files etc) which are data, i.e not part of the application code - uploaded and modified by users. The number of files is in the 1000s and the ...
-1
votes
1answer
79 views

Moving large size directory using rsync

I plan to move from linux o/s a directory which is mounted on SAN(offboard) to external storage for backup. The dir size is 14TB. I do have experience moving files in/out using rsync but never done ...
-1
votes
1answer
120 views

Fastest way to copy small files over secure network without regard for file mod times or size

I want to sync files in dir1 and dir2 (two different servers). I do not care if the file sizes or modification times differ. EXAMPLE: dir1 contains file1, file2, file3, file4, and dir2 contains ...
1
vote
2answers
721 views

Convert raidz1 to raidz2 via a temporary drive

I set up a new NAS server a few months ago and set it as RaidZ. I'm re-thinking that decision and would like to grab an extra drive and move to RaidZ2. Before everyone replies that this isn't possible ...
0
votes
1answer
47 views

Inverse of rsync --copy-links?

Server, a directory with a bunch of symlinks in it pointing to things I want to sync: /home/shish/tosync/video.mp4 -> /home/shish/videos/video.mp4 /home/shish/tosync/code.py -> /home/shish/src/...
1
vote
0answers
102 views

rsync daemon without rsyncd.conf

Will rsyncd run without its config file (rsyncd.conf) ? What is its behavior if run this way? Backstory: So, I'm using rsync to backup user directories from (call it) server A, and it's working ...
3
votes
1answer
727 views

GlusterFS snapshot backup solution

We're looking for a fast way to take point in time snapshots of our gluster bricks. It is not crucial that it is a perfect point in time snapshot (i.e if files change/get added/removed during the ...
-5
votes
1answer
78 views

How to prevent attacker from taking advantage of rsync for destroy target server [closed]

Rsync is an awesome tool. But I think if one attacker is possible to intrude my server and take advantage of rsync for removing data of other server: sudo rsync -avzP --delete /tmp/emptyfolder -e "...
1
vote
0answers
93 views

Rsync does not delete destination files [rsync protocol / module]

An automatic backup script executes the following rsync command to sync a local directory tree with a remote one: env RSYNC_PASSWORD=$rsync_password rsync -aqrxz --delete --timeout=30 \ "${...
0
votes
1answer
223 views

rsync not behaving the same in script vs shell

Afternoon ServerFault, I have hit a problem that I can seem to reach a solution to, I currently have a backup script that is meant to rsync VMs off our VMWare box onto our backup server, the problem ...
0
votes
2answers
60 views

Rsyncing to a compressed zpool

I've been Rsyncing from an NFS mount to a local zpool that has compression enabled on it. When I rsync, it copies every file over, not just the new/changed ones. Is this because the file size is ...
0
votes
1answer
50 views

How to act upon condition of whether a file updated via Rsync was updated

I think this is simple but I can't find anything in my googling, maybe I'm searching the wrong terms. I have a machine that syncs itself to another machine. If there are changes to a file on the ...
0
votes
1answer
1k views

Rsync keeps asking for password even though a secrets file is configured, what could be the reason?

I've configured rsync on one of my servers, the configuration looks like that: [root@pnmpg4 ~]# cat /etc/rsyncd.conf max connections = 2 log file = /var/log/rsync.log timeout = 300 [hadoop_out]...
0
votes
1answer
136 views

rsync: how will rsync react to a file copy from a mounted share to a remote location?

I have a task to create a passive sync between a production server and a staging server which are located in two different geographical locations. The environment is fully Linux based (CentOS/RHEL) ...
1
vote
1answer
110 views

Which compressed file formats are efficient with rsync?

Every system admin knows that rsync is the way to go if you need to do backups of large files, e. g. a database file: since it uses delta compression, it only overwrites blocks that have been modified ...
1
vote
1answer
2k views

rsync to unmounted webdav share

if I want to transfer files to a webdav share, can I do that directly to the server that the share originates from, or does it need to be mounted on the machine that I send the rsync to? The thing is, ...
1
vote
1answer
333 views

rsync using only spare bandwidth?

My scenario: Several rural schools Every school: One linux server Limited bandwidth (shared with all school PCs) Electricity not guaranteed (last to leave the school could cut all electricity) ...
-2
votes
1answer
346 views

Looking For Simple, Fast Incremental Backup Algorithm Using RSYNC [closed]

I'm running a simple bash script that uses rsync to do an incremental backup of my web server every hour. What I'm looking for is an efficient algorithm to delete the proper backups so that in the end ...
1
vote
1answer
703 views

Prevent rsync from deleting excluded directories

I'm using rsync through Ansible's synchronize-module with the following task definition: synchronize: src='{{ local_app_path }}/.' dest='{{ remote_app_path }}/' perms=no owner=yes rsync_opts=--delete-...
1
vote
1answer
55 views

Running two mutually exclusive rsync on the same folder

I have files stored on two servers, A and B. I'd like to copy both into the same directory tree on server C. Is it safe to run both of these commands at once if A and B have the same folder structure, ...
1
vote
3answers
289 views

Quickest way to replicate small files on 4 machines?

I have 4 servers, all on a secure local network. Each server runs script.php (every minute). script.php reads from a local dir called /arc, does a file test, and writes a new file back to /arc. (...
0
votes
1answer
561 views

rsync on OS X changes folder's group name to _lpoperator

Here is how to demo the problem: Grab Terminal on OSX, and run cd ~ && mkdir abc && ls -l ~/ Here is the output about folder "abc": drwxr-xr-x 2 justin staff 68 Jan 4 20:...