Rsync is a fast and extraordinarily versatile file copying tool. It can copy locally, to/from another host over any remote shell, or to/from a remote rsync daemon

learn more… | top users | synonyms

1
vote
3answers
1k views

Using Rsync to backup a Windows Share

I have a Windows 7 box that I want to back up to an Ubuntu machine. I have mounted a Windows share on the Ubuntu box (using CIFS/Samba), and I want to use a cron job to rsync what's on the mounted ...
13
votes
9answers
18k views

Sync LVM snapshots to backup server

I have a number of Xen virtual machines running on a number of Linux servers. These VMs store their disk images in Linux LVM volumes with device names along the lines of /dev/xenVG/SERVER001OS and so ...
0
votes
1answer
34 views

re-sync a single large file using rsync

I have large disksafe file(71GB) created on R1soft server.I want to keep a copy of it to a remote backup server and syncing it when there's any change(after replication is complete). From what I ...
1
vote
1answer
1k views

rsync unexplained error & received SIGINT, SIGTERM, or SIGHUP

I created a batch script to back-up our server: #!/bin/bash user=$1 # create user dir ssh root@local.backup.tst -p 5774 mkdir -p /var/backup/server.tst/incremental/$user # backup mail dir rsync ...
2
votes
5answers
9k views

rsync --files-from or --include-from

I try command rsync -v --include-from=/path/to/list.lst /home/user /path/to/backup list.lst contains for example .gnupg/ .pki/ .gnome2/keyrings/ .mozilla/firefox/*.default/bookmarkbackups/ ...
0
votes
1answer
22 views

Excluding absolute paths in rsync

The man page for rsync suggests that I should be able to write -/ /home/me/foo in exclude.foo and then run rsync -a --exclude-from exclude.foo /any/path/ /dest/ and have /home/me/foo excluded, ...
0
votes
3answers
61 views

Is is possible to live sync two network drives?

I have one NAS in India (active) and while other in US(passive). I want to sync the US NAS with that of India in real time (with permissible latency) I tried using RAID1 for this purpose, but I ...
0
votes
4answers
2k views

Rsync / Sqlite database

Does anyone have ever tried rsync'ing sqlite database? Is it possible to access the data while it gets syncronised?
1
vote
2answers
865 views

s3fs Input/output error

I'm trying to set up a backup system with s3fs and the Amazon S3 service. I followed this this guide and this guide. Tailing /var/log/messages I get: Aug 28 13:37:46 server s3fs:###response=403 I ...
-1
votes
1answer
18 views

How to rsync to other directory

This is my rsync command rsync --delete /src-dirname /dest-dirname This creates /dest-dirname/src-dirname at the destination. What I want is to sync all files and directories underneath ...
1
vote
2answers
4k views

Rsync command issues, owner and group permissions doesn´t change

I´m trying to set owner and group via rsync and it doesn't seem to be working. This is the command: sudo rsync -rlptDvz --owner=cmsseren --group=cmsseren /home/serena/public_html/ -e ssh ...
7
votes
5answers
9k views

How can one efficiently use S3 to back up files incrementally?

I understand how rsync works on a high-level, but there are 2 sides. With S3 there is no daemon to speak of — well there is, but it's basically just HTTP. There look to be a few approaches. s3rsync ...
2
votes
9answers
2k views

Syncing files with rsync by file names only, ignore directories

I'm trying to sync files from System A to System B. However, the files are re-organized in another directory structure, which makes usage of rsync difficult. Is there any way to tell rsync to ignore ...
2
votes
1answer
2k views

Rsync: windows 7, synology: login error and permission denied error

Good day to all of you all, I'm running into strange/stupid errors, and I hope anybody would be so kind to help me out. I have to admit, I am by no means a guru, so please bear with me :-) ...
3
votes
3answers
183 views

rsync many small files with long filenames takes a lot of bandwidth

I have a file storage server which stores files on disk using the file's sha256 hash as the filename, along with the file extension, and in three levels of directories, e.g. a PDF file with sha256 ...
-2
votes
2answers
55 views

Initate RSync From Webpage

I use rsync for backups. I'd like a script that when someone visits a certain url (It will be private and internal only) that it will start a rsync job on demand straight away. Could someone advise ...
-2
votes
2answers
94 views

fastest way to transfer small files (faster than scp) [closed]

Scp is quite slow for transferring individual files. What is the quickest way to do this? The reason I need speed is not because I have a large number of files to transfer. I just want the individual ...
2
votes
2answers
571 views

How do I write an rsync exclude for a directory tree with names containing spaces?

I'm trying to exclude a directory tree as part of an rsync command embedded in a bash script approximately like this: $OPTIONS="-rl --exclude 'Some Parent Directory/Another Directory'" rsync ...
1
vote
1answer
890 views

How do I get rsync to listen on two different ports via xinetd?

I have multiple servers that receive files via rsync on different ports. I'd like to merge them into the same physical server and let the clients continue to direct their files to the same port they ...
2
votes
1answer
45 views

Rsync and off-lined data on tape

I have a backup system handling large amounts of data. I use rsync to backup the data to a remote directory. In the remote location they archive their data on tape for security reasons. The data is ...
0
votes
0answers
26 views

Can anyone please explain how to fix the following errors on RSNAPSHOT?

Some errors occurs during the daily backup of VM's at 1am and is mailed daily with the following output. ***MAIL CONTENT*** ERRORS ERROR: Warning! Could not symlink("PAM.7.gz"), ...
1
vote
0answers
22 views

Why is rsnapshot claiming source directory doesn't exist?

I'm trying to set up a backup system using rsnapshot which will copy files from a remote location into a local one. I've got rsnapshot set up, as far as I can see correctly, but when I run rsnapshot ...
1
vote
2answers
2k views

Rsync Exit Code Checker - Bash

I have a simple script on my home server to sync data to my backup drive to be stored. Right now it runs multiple rsyncs one after another. Sometimes rsync fails on one or two of them. When this ...
1
vote
3answers
3k views

Rsync Permissions from One Server to Another - Mkdir Permission denied (13)

I am trying to use rsync to copy a backup folder on a local machine to another machine daily (in case of data loss or accidental deletion). This runs as a cronjob. I just the command rsync -av ...
1
vote
0answers
110 views

Unable to use rsnapshot to sync non-owned files but able to do it with plain rsync command

I am trying to use rsnapshot to sync remote file to my own computer. However, I have some trouble when I need to access files which are not owned by user who is SSH-ing to the remote machine. My ...
0
votes
2answers
20 views

Rsync through secure head-node on storage cluster

I wish to use a specific head-node as contact address for my rsync backups, I do no wish to have the backend accessed directly, as it is not as hardened, nor as compatible with the rest of my ...
2
votes
2answers
354 views

rsnapshot: WARNING: Some files and/or directories in / vanished during rsync operation

I once in a while get this message in my rsnapshot log, and an identical message in /var/log/messages. Unfortunately, there is no other deviation from normal output, despite loglevel 5 in ...
1
vote
5answers
183 views

Automate and create SSH keys for large number(Nearly 9000) of servers for almost 30 users

Is there a way to automate to create SSH keys for large number(Nearly 9000) of servers for almost 30 users
0
votes
1answer
30 views

How do I rsync specific folders only

I want to rsync only selected folders from within a directory to a remote server. The folders are listed in files.txt user1/ user2/ rsync --dry-run -avv --include-from '/home/files.txt' /home/ -e ...
0
votes
2answers
1k views

How to rsync files / folders from a specific date forward?

I would like to rsync folders from a specific date and forward. for example. I want to rsync my folders that were created from 3 days ago (and of course 2 days ago, one day ago etc.). I know I need to ...
1
vote
1answer
48 views

Syncing rsnapshot backup drives

I have a pair of USB drives I use for backing up to via rsnapshot. One drive is left plugged in and the other is taken off site. For the first swap, I ran "rsync -aH" to copy all the contents from ...
1
vote
2answers
270 views

rsync: mkdir “2014-11/.” failed: No such file or directory (2)

i'm write a script for automation copying file with rsync from server-a to server-b this is my script : #!/bin/bash NOW=$(date +"%Y-%m") rsync -au --ignore-existing /var/www/uploads/$NOW/* -e ...
1
vote
4answers
1k views

Crontab + Rsync - nothing happens :(

Hello the interesting line in my crontab looks like this: (edited & saved it by running crontab -e) 23 * * * * rsync -av --delete root@example.de:/var/www/ /home/niklas >> ...
0
votes
2answers
34 views

how to do synchronization with multiple servers?

we have 3 web servers with load balancer.for example 192.168.1.1,192.168.1.2,192.168.1.3.now if i upload a file or directory in 192.168.1.1,it should be reflected in other webservers. samewise if i ...
2
votes
3answers
378 views

Install rsync on VMware ESX 4.1 server

I have a Red Hat Enterprise Linux Server release 5.1 (Tikanga) VMware ESX 4.1 (Kandinsky), and my plan is to backup the files from the box to a NAS in another host. I have already resolve the ssh ...
0
votes
1answer
36 views

Keeping multiple Apache servers in sync

Overview Currently my company runs 5 web servers that hook into 1 DB/Fileshare server. The DB/Fileshare server uses NFS to mount on the 5 webservers so we only have to update the code once because ...
0
votes
0answers
66 views

rsync termiates after a while unexpectedly

I run a rsync command with nohup in ssh session, but after a while it returns this error: rsync error: received SIGINT, SIGTERM, or SIGHUP (code 20) at rsync.c(549) [generator=3.0.9] rsync error: ...
1
vote
1answer
69 views

Copy file from Windows host to Linux host via Rsync, then set permissions

So I have a Windows SFTP server (SFTPSERVER), which receives files (duh). I then need to push those files to a Linux server (AD authenticated to my domain) elsewhere in my organzation. So that bit I ...
78
votes
15answers
86k views

Copying a large directory tree locally? cp or rsync?

I have to copy a large directory tree, about 1.8 TB. It's all local. Out of habit I'd use rsync, however I wonder if there's much point, and if I should rather use cp. I'm worried about permissions ...
2
votes
2answers
179 views

Possibility of WAN Optimization for SSH traffic

While I do understand that SSH by itself is a very low bandwidth utilizing protocol, it is sometimes choking up bandwidth during peak hours in our office environment. I want to know if at all it is ...
0
votes
0answers
6 views

rsync: local to local comparing to remote

I have the following setup: /data/MyData/*= my local source /media/USB_HDD_1/data/MyData = my local destination (external hard drive) xx.xx.xx.xx:/data/MyDat = remote server (remote and local source ...
0
votes
2answers
434 views

How to transfer large files between two remotes by using a third machine?

I need to automatically mirror a large amount (terabytes) of files in two unix machines over a slow link (1 Mbps). This needs to be done frequently, but the data doesn't change too much (delta ...
11
votes
3answers
4k views

Why it's not possible to use two remotes for rsync? [closed]

When both source and destination are remote, rsync complains: The source and destination cannot both be remote. rsync error: syntax or usage error (code 1) at main.c(1156) [Receiver=3.0.7] Is there ...
1
vote
1answer
83 views

rsync --include-from & delete = extra files removed

I have 2 dirs: src and dst. Src contains only 1 file "index.php". Dst contains "index.php" AND "readme.txt". I also have a list.txt file, which contains only one line: "index.php". Now, being in the ...
1
vote
1answer
42 views

rsync taking 100% of CPU and hours to complete

So I have a pretty simple backup script that runs as a cron job every night and it is: rsync -azhv /company/shared_files/ /mnt/ext_drive/backups/shared_files/company_share_backup_"`date ...
1
vote
2answers
357 views

rsync --iconv option on Mac not working (sync from remote Linux server to local Mac)

I want to use rsync to backup data from a remote Linux server to my local Mac. And I want to initialise this operation on my local Mac. All works fine except that there is a special character problem: ...
8
votes
5answers
13k views

Is there any other reason for “no space left on device”?

I am using Dirvish on a Ubuntu server system for backing up a hd to an external usb 3.0 drive. Until a few days ago, everything worked fine, but now every backup fails with "no space left on device ...
22
votes
3answers
26k views

Why is my rsync so slow?

My Laptop and my workstation are both connected to a Gigabit Switch. Both are running Linux. But when I copy files with rsync, it performs badly. I get about 22 MB/s. Shouldn't I theoretically get ...
1
vote
1answer
113 views

Rsync failing with “file too large”

I am writing what should be a simple backup script to copy all of my media files to an external USB drive. There seems to be one file that it chokes on and I'm not sure why. Just trying to copy that ...
5
votes
2answers
75 views

full or incremental backup of large number of files

I have a large amount of files in both quantity and total file size. (we're talking a few terabytes). I would like to sync these files/folders once to an external backup system, then run a daily task ...