Rsync is a fast and extraordinarily versatile file copying tool. It can copy locally, to/from another host over any remote shell, or to/from a remote rsync daemon

learn more… | top users | synonyms

0
votes
1answer
299 views

rsync to unmounted webdav share

if I want to transfer files to a webdav share, can I do that directly to the server that the share originates from, or does it need to be mounted on the machine that I send the rsync to? The thing is, ...
1
vote
1answer
98 views

rsync using only spare bandwidth?

My scenario: Several rural schools Every school: One linux server Limited bandwidth (shared with all school PCs) Electricity not guaranteed (last to leave the school could cut all electricity) ...
-2
votes
1answer
153 views

Looking For Simple, Fast Incremental Backup Algorithm Using RSYNC [closed]

I'm running a simple bash script that uses rsync to do an incremental backup of my web server every hour. What I'm looking for is an efficient algorithm to delete the proper backups so that in the end ...
1
vote
1answer
236 views

Prevent rsync from deleting excluded directories

I'm using rsync through Ansible's synchronize-module with the following task definition: synchronize: src='{{ local_app_path }}/.' dest='{{ remote_app_path }}/' perms=no owner=yes ...
1
vote
1answer
35 views

Running two mutually exclusive rsync on the same folder

I have files stored on two servers, A and B. I'd like to copy both into the same directory tree on server C. Is it safe to run both of these commands at once if A and B have the same folder structure, ...
1
vote
3answers
106 views

Quickest way to replicate small files on 4 machines?

I have 4 servers, all on a secure local network. Each server runs script.php (every minute). script.php reads from a local dir called /arc, does a file test, and writes a new file back to /arc. ...
0
votes
1answer
135 views

rsync on OS X changes folder's group name to _lpoperator

Here is how to demo the problem: Grab Terminal on OSX, and run cd ~ && mkdir abc && ls -l ~/ Here is the output about folder "abc": drwxr-xr-x 2 justin staff 68 Jan 4 ...
0
votes
5answers
104 views

Rsync to a backup server resulted in additional space taken

I ran an rsync to backup one of our production servers. I put the production server in readonly mode so that no additional data could be added or modified. I then did a recursive rsync with archive ...
0
votes
1answer
61 views

re-sync a single large file using rsync

I have large disksafe file(71GB) created on R1soft server.I want to keep a copy of it to a remote backup server and syncing it when there's any change(after replication is complete). From what I ...
0
votes
1answer
27 views

Excluding absolute paths in rsync

The man page for rsync suggests that I should be able to write -/ /home/me/foo in exclude.foo and then run rsync -a --exclude-from exclude.foo /any/path/ /dest/ and have /home/me/foo excluded, ...
-1
votes
1answer
23 views

How to rsync to other directory

This is my rsync command rsync --delete /src-dirname /dest-dirname This creates /dest-dirname/src-dirname at the destination. What I want is to sync all files and directories underneath ...
0
votes
3answers
97 views

Is is possible to live sync two network drives?

I have one NAS in India (active) and while other in US(passive). I want to sync the US NAS with that of India in real time (with permissible latency) I tried using RAID1 for this purpose, but I ...
4
votes
3answers
358 views

rsync many small files with long filenames takes a lot of bandwidth

I have a file storage server which stores files on disk using the file's sha256 hash as the filename, along with the file extension, and in three levels of directories, e.g. a PDF file with sha256 ...
-2
votes
2answers
58 views

Initate RSync From Webpage

I use rsync for backups. I'd like a script that when someone visits a certain url (It will be private and internal only) that it will start a rsync job on demand straight away. Could someone advise ...
-2
votes
2answers
451 views

fastest way to transfer small files (faster than scp) [closed]

Scp is quite slow for transferring individual files. What is the quickest way to do this? The reason I need speed is not because I have a large number of files to transfer. I just want the individual ...
2
votes
1answer
78 views

Rsync and off-lined data on tape

I have a backup system handling large amounts of data. I use rsync to backup the data to a remote directory. In the remote location they archive their data on tape for security reasons. The data is ...
2
votes
2answers
59 views

Why is rsnapshot claiming source directory doesn't exist?

I'm trying to set up a backup system using rsnapshot which will copy files from a remote location into a local one. I've got rsnapshot set up, as far as I can see correctly, but when I run rsnapshot ...
1
vote
0answers
330 views

Unable to use rsnapshot to sync non-owned files but able to do it with plain rsync command

I am trying to use rsnapshot to sync remote file to my own computer. However, I have some trouble when I need to access files which are not owned by user who is SSH-ing to the remote machine. My ...
0
votes
2answers
24 views

Rsync through secure head-node on storage cluster

I wish to use a specific head-node as contact address for my rsync backups, I do no wish to have the backend accessed directly, as it is not as hardened, nor as compatible with the rest of my ...
0
votes
1answer
54 views

How do I rsync specific folders only

I want to rsync only selected folders from within a directory to a remote server. The folders are listed in files.txt user1/ user2/ rsync --dry-run -avv --include-from '/home/files.txt' /home/ -e ...
1
vote
2answers
2k views

rsync: mkdir “2014-11/.” failed: No such file or directory (2)

i'm write a script for automation copying file with rsync from server-a to server-b this is my script : #!/bin/bash NOW=$(date +"%Y-%m") rsync -au --ignore-existing /var/www/uploads/$NOW/* -e ...
0
votes
1answer
85 views

Keeping multiple Apache servers in sync

Overview Currently my company runs 5 web servers that hook into 1 DB/Fileshare server. The DB/Fileshare server uses NFS to mount on the 5 webservers so we only have to update the code once because ...
2
votes
0answers
480 views

rsync termiates after a while unexpectedly

I run a rsync command with nohup in ssh session, but after a while it returns this error: rsync error: received SIGINT, SIGTERM, or SIGHUP (code 20) at rsync.c(549) [generator=3.0.9] rsync error: ...
0
votes
2answers
64 views

how to do synchronization with multiple servers?

we have 3 web servers with load balancer.for example 192.168.1.1,192.168.1.2,192.168.1.3.now if i upload a file or directory in 192.168.1.1,it should be reflected in other webservers. samewise if i ...
1
vote
1answer
196 views

Copy file from Windows host to Linux host via Rsync, then set permissions

So I have a Windows SFTP server (SFTPSERVER), which receives files (duh). I then need to push those files to a Linux server (AD authenticated to my domain) elsewhere in my organzation. So that bit I ...
0
votes
0answers
11 views

rsync: local to local comparing to remote

I have the following setup: /data/MyData/*= my local source /media/USB_HDD_1/data/MyData = my local destination (external hard drive) xx.xx.xx.xx:/data/MyDat = remote server (remote and local source ...
1
vote
1answer
410 views

rsync --include-from & delete = extra files removed

I have 2 dirs: src and dst. Src contains only 1 file "index.php". Dst contains "index.php" AND "readme.txt". I also have a list.txt file, which contains only one line: "index.php". Now, being in the ...
1
vote
1answer
82 views

rsync taking 100% of CPU and hours to complete

So I have a pretty simple backup script that runs as a cron job every night and it is: rsync -azhv /company/shared_files/ /mnt/ext_drive/backups/shared_files/company_share_backup_"`date ...
1
vote
2answers
2k views

rsync --iconv option on Mac not working (sync from remote Linux server to local Mac)

I want to use rsync to backup data from a remote Linux server to my local Mac. And I want to initialise this operation on my local Mac. All works fine except that there is a special character problem: ...
2
votes
2answers
567 views

Possibility of WAN Optimization for SSH traffic

While I do understand that SSH by itself is a very low bandwidth utilizing protocol, it is sometimes choking up bandwidth during peak hours in our office environment. I want to know if at all it is ...
2
votes
1answer
885 views

Rsync failing with “file too large”

I am writing what should be a simple backup script to copy all of my media files to an external USB drive. There seems to be one file that it chokes on and I'm not sure why. Just trying to copy that ...
5
votes
2answers
174 views

full or incremental backup of large number of files

I have a large amount of files in both quantity and total file size. (we're talking a few terabytes). I would like to sync these files/folders once to an external backup system, then run a daily task ...
-2
votes
1answer
258 views

Download your files from your dedicated server to synology [closed]

I'm trying to write a program/script to download files from my dedicated server (CPanel) to my Local synology. Ideally, I would like to sync it, but for now I'd rather just download. I found this ...
0
votes
1answer
118 views

Using hostname rather than IP address in /etc/rsyncd.conf not working

From what I understand from the rsync docs, I should be able to use a hostname with hosts allow. However, it does not work. This works: pid file = /var/run/rsyncd.pid syslog facility = rsync.log ...
1
vote
5answers
228 views

Automate and create SSH keys for large number(Nearly 9000) of servers for almost 30 users

Is there a way to automate to create SSH keys for large number(Nearly 9000) of servers for almost 30 users
0
votes
1answer
133 views

SVN Post Commit Issue (Calling Bash)

All, I would like to invoke a bash script (to do some rsync magic) towards the end of my post-commit hook. Here is what my post commit hook looks like: #!/bin/bash REPOS="$1" REV="$2" ...
0
votes
1answer
103 views

Sync Code Between EC2's [Rsync/SSH]

I have a variety of EC2 boxes inside an ELB, one of which is used for SVN exclusively. I currently have a script that gets called as part of the post-commit hook which is meant to sync files between ...
0
votes
1answer
87 views

Prevent rsync from changing ctime

I have the following scenario: I have files in one directory where there is a process that is changing some files and updating the ctime on all files. I want to rsync all files to a target directory ...
2
votes
1answer
187 views

rsync --link-dest not working over samba?

I'm trying to wrap my head around rsync behaviour when using --link-dest as my personal backup. My setup is a Mac Pro with a separate data partition which I want to backup to an ubuntu server. Trying ...
1
vote
3answers
223 views

rsync using keygen login in bash script

So I have set up a password-less ssh login for a server. I can run rsync from the command line, and it works beautifully, and doesn't ask me for a password: rsync -avz -e ssh myDir ...
0
votes
3answers
30 views

Can I use rsync to synchronise files in all directions?

I am setting up a webserver cluster and there is the facility for certain files to be uploaded. This can happen on any of the web nodes and I am trying to work out the best way to distribute the ...
0
votes
1answer
133 views

rsync backup remote server maintaining groups and owner

This might seem like a problem that should have been covered millions of times but I am running into issues that after days of scouring the net, I still can fix. I have a remote server that I want to ...
-1
votes
2answers
84 views

Is there a simple way to automatically send through scp any file modified in a folder to a remote folder? (one-way synchronization) [closed]

Put it simply: I have a folder full of files and subfolders with more files. I would like to have a mirror of that folder in a remote server so anytime a file is modified on my machine it gets ...
1
vote
1answer
76 views

Syncing rsnapshot backup drives

I have a pair of USB drives I use for backing up to via rsnapshot. One drive is left plugged in and the other is taken off site. For the first swap, I ran "rsync -aH" to copy all the contents from ...
0
votes
0answers
213 views

rsync hanging on local copy

I've inherited a system for moving ("promoting") content from one django instance (staging) to another (production). I'm testing a bit of new functionality in another part of the app, and want to make ...
4
votes
1answer
232 views

Preserving existing destination symlinks with rsync

I am using rsync to keep a local debian repository updated. Recently, the disk I am using to store it started running low on space, so I decided to use symlinks to allow me to move some of the ...
-1
votes
1answer
162 views

Is rsync more robust than scp for connection reset?

On a big corporate firewall-ridden network, we have traditionally used scp to copy a few brand new files over from one machine to another, as part of the log-file rotation and analysis routine. ...
1
vote
1answer
41 views

Why rsync still tries to copy and complains not enough space?

I am using rsync to copy one big file (> 4 GB) from hard disk to usb drive with "-av --progress" option. Before that, the file already exists on the usb and is the same as the one on disk. So ...
0
votes
1answer
2k views

rsync fails - No space left on device (28)

I want to backup ~5 GB of photos from one server to another. Rsync downloads about 80% of all files and then synchronization fails: rsync: write failed on "/var/www/sync/3655467597474553464543.jpg": ...
5
votes
1answer
433 views

Rsync + public key authentication security

I have read several articles how to automatically backup files with Rsync and public key authentication. All of them are very similar. I just finished setting up everything and everything works fine ...