Rsync is a fast and extraordinarily versatile file copying tool. It can copy locally, to/from another host over any remote shell, or to/from a remote rsync daemon

learn more… | top users | synonyms

2
votes
0answers
26 views

Solution for file data backup, versioning and replication

We have a growing set of data files (.wav files, image files etc) which are data, i.e not part of the application code - uploaded and modified by users. The number of files is in the 1000s and the ...
-1
votes
1answer
49 views

Moving large size directory using rsync

I plan to move from linux o/s a directory which is mounted on SAN(offboard) to external storage for backup. The dir size is 14TB. I do have experience moving files in/out using rsync but never done ...
-1
votes
1answer
19 views

Fastest way to copy small files over secure network without regard for file mod times or size

I want to sync files in dir1 and dir2 (two different servers). I do not care if the file sizes or modification times differ. EXAMPLE: dir1 contains file1, file2, file3, file4, and dir2 contains ...
1
vote
0answers
21 views

Convert raidz1 to raidz2 via a temporary drive

I set up a new NAS server a few months ago and set it as RaidZ. I'm re-thinking that decision and would like to grab an extra drive and move to RaidZ2. Before everyone replies that this isn't possible ...
0
votes
1answer
18 views

Inverse of rsync --copy-links?

Server, a directory with a bunch of symlinks in it pointing to things I want to sync: /home/shish/tosync/video.mp4 -> /home/shish/videos/video.mp4 /home/shish/tosync/code.py -> ...
0
votes
0answers
9 views

Backup SugarCRM using RSync to copy the backup to new server and keep file permissions and owners in tact when restoring from the backups

Backup SugarCRM using RSync to copy the backup to new server and keep file permissions and owners in tact so a restore will have the correct file permissions and owners when a restore back to the ...
1
vote
0answers
10 views

rsync daemon without rsyncd.conf

Will rsyncd run without its config file (rsyncd.conf) ? What is its behavior if run this way? Backstory: So, I'm using rsync to backup user directories from (call it) server A, and it's working ...
0
votes
0answers
55 views

GlusterFS snapshot backup solution

We're looking for a fast way to take point in time snapshots of our gluster bricks. It is not crucial that it is a perfect point in time snapshot (ie if files change/get added/removed during the ...
-5
votes
1answer
44 views

How to prevent attacker from taking advantage of rsync for destroy target server [closed]

Rsync is an awesome tool. But I think if one attacker is possible to intrude my server and take advantage of rsync for removing data of other server: sudo rsync -avzP --delete /tmp/emptyfolder -e ...
1
vote
0answers
25 views

Rsync does not delete destination files [rsync protocol / module]

An automatic backup script executes the following rsync command to sync a local directory tree with a remote one: env RSYNC_PASSWORD=$rsync_password rsync -aqrxz --delete --timeout=30 \ ...
0
votes
1answer
26 views

rsync not behaving the same in script vs shell

Afternoon ServerFault, I have hit a problem that I can seem to reach a solution to, I currently have a backup script that is meant to rsync VMs off our VMWare box onto our backup server, the problem ...
0
votes
2answers
42 views

Rsyncing to a compressed zpool

I've been Rsyncing from an NFS mount to a local zpool that has compression enabled on it. When I rsync, it copies every file over, not just the new/changed ones. Is this because the file size is ...
0
votes
0answers
49 views

rsnapshot: cp: preserving permissions – operation not supported

I am trying to use rsnapshot for backuping my server on mounted nfs filesystem, but it keeps failing on: /bin/cp: preserving permissions for `...': Operation not supported Backup configuration is ...
0
votes
1answer
21 views

How to act upon condition of whether a file updated via Rsync was updated

I think this is simple but I can't find anything in my googling, maybe I'm searching the wrong terms. I have a machine that syncs itself to another machine. If there are changes to a file on the ...
1
vote
1answer
40 views

Rsync keeps asking for password even though a secrets file is configured, what could be the reason?

I've configured rsync on one of my servers, the configuration looks like that: [root@pnmpg4 ~]# cat /etc/rsyncd.conf max connections = 2 log file = /var/log/rsync.log timeout = 300 ...
0
votes
1answer
33 views

rsync: how will rsync react to a file copy from a mounted share to a remote location?

I have a task to create a passive sync between a production server and a staging server which are located in two different geographical locations. The environment is fully Linux based (CentOS/RHEL) ...
1
vote
1answer
35 views

Which compressed file formats are efficient with rsync?

Every system admin knows that rsync is the way to go if you need to do backups of large files, e. g. a database file: since it uses delta compression, it only overwrites blocks that have been modified ...
0
votes
1answer
44 views

rsync to unmounted webdav share

if I want to transfer files to a webdav share, can I do that directly to the server that the share originates from, or does it need to be mounted on the machine that I send the rsync to? The thing is, ...
1
vote
1answer
61 views

rsync using only spare bandwidth?

My scenario: Several rural schools Every school: One linux server Limited bandwidth (shared with all school PCs) Electricity not guaranteed (last to leave the school could cut all electricity) ...
-3
votes
1answer
78 views

Looking For Simple, Fast Incremental Backup Algorithm Using RSYNC [closed]

I'm running a simple bash script that uses rsync to do an incremental backup of my web server every hour. What I'm looking for is an efficient algorithm to delete the proper backups so that in the end ...
1
vote
1answer
80 views

Prevent rsync from deleting excluded directories

I'm using rsync through Ansible's synchronize-module with the following task definition: synchronize: src='{{ local_app_path }}/.' dest='{{ remote_app_path }}/' perms=no owner=yes ...
0
votes
1answer
21 views

Running two mutually exclusive rsyncs on the same folder

I have files stored on two servers, A and B. I'd like to copy both into the same directory tree on server C. Is it safe to run both of these commands at once if A and B have the same folder structure, ...
1
vote
3answers
85 views

Quickest way to replicate small files on 4 machines?

I have 4 servers, all on a secure local network. Each server runs script.php (every minute). script.php reads from a local dir called /arc, does a file test, and writes a new file back to /arc. ...
0
votes
1answer
49 views

rsync on OS X changes folder's group name to _lpoperator

Here is how to demo the problem: Grab Terminal on OSX, and run cd ~ && mkdir abc && ls -l ~/ Here is the output about folder "abc": drwxr-xr-x 2 justin staff 68 Jan 4 ...
0
votes
5answers
65 views

Rsync to a backup server resulted in additional space taken

I ran an rsync to backup one of our production servers. I put the production server in readonly mode so that no additional data could be added or modified. I then did a recursive rsync with archive ...
0
votes
1answer
43 views

re-sync a single large file using rsync

I have large disksafe file(71GB) created on R1soft server.I want to keep a copy of it to a remote backup server and syncing it when there's any change(after replication is complete). From what I ...
0
votes
1answer
25 views

Excluding absolute paths in rsync

The man page for rsync suggests that I should be able to write -/ /home/me/foo in exclude.foo and then run rsync -a --exclude-from exclude.foo /any/path/ /dest/ and have /home/me/foo excluded, ...
-1
votes
1answer
22 views

How to rsync to other directory

This is my rsync command rsync --delete /src-dirname /dest-dirname This creates /dest-dirname/src-dirname at the destination. What I want is to sync all files and directories underneath ...
0
votes
3answers
75 views

Is is possible to live sync two network drives?

I have one NAS in India (active) and while other in US(passive). I want to sync the US NAS with that of India in real time (with permissible latency) I tried using RAID1 for this purpose, but I ...
4
votes
3answers
282 views

rsync many small files with long filenames takes a lot of bandwidth

I have a file storage server which stores files on disk using the file's sha256 hash as the filename, along with the file extension, and in three levels of directories, e.g. a PDF file with sha256 ...
-2
votes
2answers
56 views

Initate RSync From Webpage

I use rsync for backups. I'd like a script that when someone visits a certain url (It will be private and internal only) that it will start a rsync job on demand straight away. Could someone advise ...
-2
votes
2answers
260 views

fastest way to transfer small files (faster than scp) [closed]

Scp is quite slow for transferring individual files. What is the quickest way to do this? The reason I need speed is not because I have a large number of files to transfer. I just want the individual ...
2
votes
1answer
62 views

Rsync and off-lined data on tape

I have a backup system handling large amounts of data. I use rsync to backup the data to a remote directory. In the remote location they archive their data on tape for security reasons. The data is ...
2
votes
2answers
43 views

Why is rsnapshot claiming source directory doesn't exist?

I'm trying to set up a backup system using rsnapshot which will copy files from a remote location into a local one. I've got rsnapshot set up, as far as I can see correctly, but when I run rsnapshot ...
0
votes
0answers
39 views

Can anyone please explain how to fix the following errors on RSNAPSHOT?

Some errors occurs during the daily backup of VM's at 1am and is mailed daily with the following output. ***MAIL CONTENT*** ERRORS ERROR: Warning! Could not symlink("PAM.7.gz"), ...
1
vote
0answers
217 views

Unable to use rsnapshot to sync non-owned files but able to do it with plain rsync command

I am trying to use rsnapshot to sync remote file to my own computer. However, I have some trouble when I need to access files which are not owned by user who is SSH-ing to the remote machine. My ...
0
votes
2answers
24 views

Rsync through secure head-node on storage cluster

I wish to use a specific head-node as contact address for my rsync backups, I do no wish to have the backend accessed directly, as it is not as hardened, nor as compatible with the rest of my ...
0
votes
1answer
39 views

How do I rsync specific folders only

I want to rsync only selected folders from within a directory to a remote server. The folders are listed in files.txt user1/ user2/ rsync --dry-run -avv --include-from '/home/files.txt' /home/ -e ...
1
vote
2answers
1k views

rsync: mkdir “2014-11/.” failed: No such file or directory (2)

i'm write a script for automation copying file with rsync from server-a to server-b this is my script : #!/bin/bash NOW=$(date +"%Y-%m") rsync -au --ignore-existing /var/www/uploads/$NOW/* -e ...
0
votes
1answer
58 views

Keeping multiple Apache servers in sync

Overview Currently my company runs 5 web servers that hook into 1 DB/Fileshare server. The DB/Fileshare server uses NFS to mount on the 5 webservers so we only have to update the code once because ...
1
vote
0answers
149 views

rsync termiates after a while unexpectedly

I run a rsync command with nohup in ssh session, but after a while it returns this error: rsync error: received SIGINT, SIGTERM, or SIGHUP (code 20) at rsync.c(549) [generator=3.0.9] rsync error: ...
0
votes
2answers
43 views

how to do synchronization with multiple servers?

we have 3 web servers with load balancer.for example 192.168.1.1,192.168.1.2,192.168.1.3.now if i upload a file or directory in 192.168.1.1,it should be reflected in other webservers. samewise if i ...
1
vote
1answer
132 views

Copy file from Windows host to Linux host via Rsync, then set permissions

So I have a Windows SFTP server (SFTPSERVER), which receives files (duh). I then need to push those files to a Linux server (AD authenticated to my domain) elsewhere in my organzation. So that bit I ...
0
votes
0answers
8 views

rsync: local to local comparing to remote

I have the following setup: /data/MyData/*= my local source /media/USB_HDD_1/data/MyData = my local destination (external hard drive) xx.xx.xx.xx:/data/MyDat = remote server (remote and local source ...
1
vote
1answer
230 views

rsync --include-from & delete = extra files removed

I have 2 dirs: src and dst. Src contains only 1 file "index.php". Dst contains "index.php" AND "readme.txt". I also have a list.txt file, which contains only one line: "index.php". Now, being in the ...
1
vote
1answer
57 views

rsync taking 100% of CPU and hours to complete

So I have a pretty simple backup script that runs as a cron job every night and it is: rsync -azhv /company/shared_files/ /mnt/ext_drive/backups/shared_files/company_share_backup_"`date ...
1
vote
2answers
906 views

rsync --iconv option on Mac not working (sync from remote Linux server to local Mac)

I want to use rsync to backup data from a remote Linux server to my local Mac. And I want to initialise this operation on my local Mac. All works fine except that there is a special character problem: ...
2
votes
2answers
329 views

Possibility of WAN Optimization for SSH traffic

While I do understand that SSH by itself is a very low bandwidth utilizing protocol, it is sometimes choking up bandwidth during peak hours in our office environment. I want to know if at all it is ...
1
vote
1answer
444 views

Rsync failing with “file too large”

I am writing what should be a simple backup script to copy all of my media files to an external USB drive. There seems to be one file that it chokes on and I'm not sure why. Just trying to copy that ...
5
votes
2answers
130 views

full or incremental backup of large number of files

I have a large amount of files in both quantity and total file size. (we're talking a few terabytes). I would like to sync these files/folders once to an external backup system, then run a daily task ...