Rsync is a fast and extraordinarily versatile file copying tool. It can copy locally, to/from another host over any remote shell, or to/from a remote rsync daemon

learn more… | top users | synonyms

2
votes
4answers
2k views

Using Rsync to backup a Windows Share

I have a Windows 7 box that I want to back up to an Ubuntu machine. I have mounted a Windows share on the Ubuntu box (using CIFS/Samba), and I want to use a cron job to rsync what's on the mounted ...
0
votes
2answers
40 views

How to make rsync delete destination directories no longer existing at source?

I have hard drive that I back up with rsync to a network-attached storage. There are some non-empty directories at the destination (the nas) that do not exist on the source anymore. It is not a ...
2
votes
2answers
938 views

Does rsync support multiple sources to a given destination in parallel

If I have multiple sources, each with the same directory tree, but different files in the tree, is it safe to run multiple rsync commands in parallel with the same destination? Specifically, will ...
1
vote
2answers
57 views

Get Zipped Logs from a Remote Server

I am tasked with trying to find a way to download zipped logs from a remote server. There are quite a bit of these logs and they are constantly created. I do have limited ssh access to the remote ...
1
vote
2answers
4k views

How do I manually install and update plugin in OpenVAS3 without rsync?

I've been assigned a task of penetration testing a server using OpenVAS3. However, I am behind a corporate firewall and OpenVAS3 uses rsync to perform updates from rsync://rsync.openvas.org:/nvt-feed ...
1
vote
1answer
1k views

rsync from Drobo to Drobo

I'd like to run a backup rsync job from one Drobo to another. I've managed to get rsync and the ssh tools installed so that I can ssh from my desktop into backup@drobo1.local and then ssh into ...
0
votes
1answer
251 views

Explain this rsync script for me - Linux backups

I don't know Linux and even less about programming so pardon my ignorance. I have this script and would like someone to explain the internals to me. I understand that the syntax of: 30 1 * * * ...
0
votes
3answers
1k views

How can make rsync use sudo

I use rsync to mirror a number of folders on our failover server. However, some of our files, such as thumbnails or full-text indexes, are generated by our applications under the web user (named ...
0
votes
1answer
39 views

rsync with --backup

I'm trying to rsync a single directory of files and store timestamped revisions at the destination. This is what I'm using at the moment: rsync --verbose --progress --stats --compress --no-whole-file ...
1
vote
1answer
2k views

rsync unexplained error & received SIGINT, SIGTERM, or SIGHUP

I created a batch script to back-up our server: #!/bin/bash user=$1 # create user dir ssh root@local.backup.tst -p 5774 mkdir -p /var/backup/server.tst/incremental/$user # backup mail dir rsync ...
0
votes
1answer
62 views

Why is FileZilla SFTP file transfer max capped at 1.3MiB/sec instead of saturating available bandwidth? rsync and WinSCP are even slower

I'm downloading from a server and downloads are maxing out at 1.3MiB/second with FileZilla but I can start concurrent downloads and they will download at 1.3MiB/second also. So why can't I download ...
0
votes
1answer
10 views

Exception reporting with rsync backups?

I run rsync in the cron every 4 hours. This works well for backups, but it generates six messages a day to root for each successful backup. I know I can put the output to /dev/null not to get any ...
1
vote
1answer
35 views

What rsync options to use for the below mentioned scenario?

Greetings !!! This is regarding a specific requirement about rsync that we are trying to achieve. We have tried to achieve this by using various rsync options. However, we are encountering different ...
2
votes
2answers
559 views

rsnapshot: WARNING: Some files and/or directories in / vanished during rsync operation

I once in a while get this message in my rsnapshot log, and an identical message in /var/log/messages. Unfortunately, there is no other deviation from normal output, despite loglevel 5 in ...
54
votes
15answers
54k views

Showing total progress in rsync: is it possible?

I have searched for this option already, but have only found solutions that involve custom patching. The fact that it does not show in --help and no more info can be found probably indicates the ...
15
votes
13answers
9k views

Complete restore of linux system

I am familiar with using rsync to back up various files from my system but what is the best way to completely restore a machine. What I have tried in the past is: Do a basic format/reinstall from ...
0
votes
0answers
33 views

backing up millions of files and 1 tb [duplicate]

I'm trying to find a fast solution that can transfer about 3 million files taking up about 1tb of space. So far after a bit of research my choices seem to be lftp and rsync. Which option would work ...
0
votes
2answers
714 views

Failover tmpfs mirroring. Am I doing it right?

My goal is to have a certain directory to be available as tmpfs. There will be some modifications during server uptime in this dir and those modifications must be synced to non-tmpfs persistent dir on ...
7
votes
2answers
2k views

Get list of transferred files from rsync?

I'm currently using rsync on a script that deploys a PHP application from a staging to a production server. Here is how: rsync -rzai --progress --stats --ignore-times --checksum /tmp/app_export/ ...
2
votes
1answer
1k views

easy way to restore incremental rsync backup?

I have incremental rsync backups of a folder, created with: rsync --delete -a -v --backup --backup-dir="../backup_`date +%Y-%m-%d`" /orig /backups/dest so I have a copy of current /orig on ...
1
vote
2answers
976 views

s3fs Input/output error

I'm trying to set up a backup system with s3fs and the Amazon S3 service. I followed this this guide and this guide. Tailing /var/log/messages I get: Aug 28 13:37:46 server s3fs:###response=403 I ...
0
votes
1answer
18 views

Maintaining rsync log file

I have a cron running rsync for backup purposes, and rsync logs the output to a file via --log-file. This script will keep on running for a quite long time and I am worried that the log file will keep ...
0
votes
0answers
17 views

Why is rsync truncating this path? [migrated]

I'm trying to synchronize a set of remote files via an rsync daemon, but the resulting path is missing the initial path element. $ rsync -HRavP ftp.ncbi.nih.gov::refseq/H_sapiens/README 2015-05-11/ ...
1
vote
1answer
909 views

rsync error on Downloading

I am trying to setup a Rsyncmirror on my mount drive /mnt/Mirror/ubuntu_mirror, so I am trying the command: rsync -a --bwlimit=128 rsync://archive.ubuntu.com/ubuntu /mnt/Mirror/ubuntu_mirror but it ...
4
votes
5answers
4k views

Rsync Remote to Remote

I'm looking for a solution for using rsync between 2 remote servers. It seems like its not possible. Does any one know why its not possible? I ask that because I think if I know the reason, maybe I ...
8
votes
6answers
18k views

Is there any other reason for “no space left on device”?

I am using Dirvish on a Ubuntu server system for backing up a hd to an external usb 3.0 drive. Until a few days ago, everything worked fine, but now every backup fails with "no space left on device ...
0
votes
3answers
75 views

rsync : write failed - No space left on device (28)

I want to rsync a folder from one server to another. But rsync synchronization fails: $ rsync -zr --compress-level=9 --delete /var/www/mywebsite/current/web/js login@192.168.1.4:/srv/data2_http ...
1
vote
1answer
362 views

resumable tar over ssh

I'd like to use tar cf - | ssh user@hostname tar xf - to copy a very large set of files. The only problem is that it will be over a very flakey VPN link. Is it possible to somehow set up a resumable ...
1
vote
1answer
1k views

How do I get rsync to listen on two different ports via xinetd?

I have multiple servers that receive files via rsync on different ports. I'd like to merge them into the same physical server and let the clients continue to direct their files to the same port they ...
1
vote
1answer
62 views

sync millions of files with rsync and inotify

I just think of one scenario when using rsync and inotify to sync millions of files. Assume I have 1 million files to sync to another server and the file list may has 20M size. When I just add one ...
0
votes
1answer
46 views

rsync snapshots backup when process is running [closed]

I have a directory which I wish to backup. However, a process is constantly writing to files in that directory and I cannot shut down this process, do the backup and restart the process. The backup ...
16
votes
8answers
10k views

How can I use rsync to duplicate a directory tree, creating hardlinks to files?

From time to time, I have to perform several large migration changes on data files on my server, and I'm looking for a good way to do this. I was thinking about using rsync to duplicate my directory ...
6
votes
3answers
6k views

How to fix corrupt packet error for with rsync for (relatively) large files?

Trying to update files on a server, with the rsync command: rsync -ravq -e "ssh -o ConnectTimeout=2 -o ServerAliveInterval=2 -ServerAliveCountMax=2" --delete ./local_dir user@$SERVER:/dest_dir ...
0
votes
0answers
17 views

Pulling Read restricted files from a remote system with rsync and sudo

A remote system generates statistics files every 5 minutes and places them in a certain directory. At any given time there are 1000+ files in that directory. Every 5 minutes I want to copy the ...
1
vote
4answers
2k views

How to avoid the Load in rsync with ssh?

I having an large amount of data (300GB) in an Linux server. Now, i want to transfer to another Linux server using the rsync over ssh. When i transferring the data it creating huge load in the server. ...
0
votes
1answer
15 views

Freshly cloned mirrored drive with Acronis true image and rsync wrongly detects changed files, windows rsync 3.0.7 cygwin windows

Is there a way to help rsync better detect that files are identical? I did a fresh full disk "clone" mirror with Acronis TrueImage and after did an rsync to test and it detected a bunch of files as ...
1
vote
2answers
252 views

Initial rdiff-backup on slow connection / large data (Could performing an rsync before help?)

I want to set up standard rdiff-backup to remote server. However the data is very big for the capacity of internet connection. Therefore I need some way to do the initial copy of data without ...
1
vote
0answers
19 views

Ubuntu 14.04 - rsync corrupting SSH configs/keys?

I have two Ubuntu 14.04 servers S1 (user root) and S2 (user dataman). S1 is responsible for handling file uploads and transferring backups to S2. On S1 I am using PubKey authentication to S2 for ...
1
vote
1answer
17 views

Using Unison / rsync over SSH to synchronize sites where full file system access is required yet root login is disabled

Assume two sites A and B with file server at either end. The contents of /storage should be synchronized between the sites, preserving ownership and permissions. There's no all encompassing group that ...
-1
votes
1answer
26 views

Pushing file to server more efficiently [closed]

I have a cluster of daemon running on Mac that generate a lot of jpg in a folder like this content/categoryname. The category name is considered as unique across multiple machine. So what is the ...
1
vote
4answers
1k views

Rsync command for offsite rolling backups

I've read a lot of articles and tried to come up my self but couldn't, so need help with Rsync command for offsite rolling backups please. I have installed cwRsync(in VMs as a test run for now) on ...
1
vote
1answer
29 views

Can rsync ignore a directory's atime entry when creating it's file list?

I am using rsync to copy data from a local LVM drive to a locally-mounted glusterfs mount. I'm trying to bring them in to sync and eventually cut over to just using the glusterfs mount. Here is the ...
1
vote
3answers
20 views

rsync for backup but don't want to wipe ( not erase ) drive

I am not sure how to even ask this question without explaining. Say I use rsync to backup drive-a to drive-b. Drive-a fails and all data is lost when the rsync went off it saw that drive-a had been ...
2
votes
0answers
67 views

Fastest ways to do backups: FTP, rsync, Robocopy, SMB/CIFS, etc? [closed]

Im looking for methods to do (incremental) backups and sync from and to NAS over LAN and VPN. Im having trouble finding couple implementations between Linux and Windows. My Linux NAS boxes have ...
45
votes
16answers
11k views

Favorite rsync tips and tricks

The more I use rsync the more I realise that it's a swiss army knife of file transfer. There are so many options. I recently found out that you can go --remove-source-files and it'll delete a file ...
0
votes
1answer
439 views

rsync --files-from specifies folders but does not copy files, recursive does not fix it

I've just recently revisited a script that I maintained a few years back and trying to get it to work on a new server. It basically runs the following rsync -vaP --copy-unsafe-links ...
11
votes
2answers
6k views

Rsync creates a directory with the same name inside of destination directory

When I run this command rsync -avzp --del -e "ssh -p myport" user@hostname:/var/www/tests /var/www/tests files get synchronized but instead of saving files in /var/www/tests, Rsync creates one more ...
1
vote
0answers
24 views

Two allowed paths in rsync command in authorized_keys

I have a question about rsync restriction in authorized_keys command. I need to copy files via rsync from one server to another without prompting password. There is no problem, but I need to specify ...
2
votes
1answer
37 views

Issue connecting SSH after using rsync

Before using rsync to copy files from local to remote I was able to do passwordless login to the remote host using ssh. This always worked: $ ssh domaster Then I used rsync and everything was fine, ...
13
votes
5answers
5k views

btrfs-enabled backup solution

With btrfs hitting production in Oracle EL 14th this month (together with working fsck and scrubbing from Linux 3.2) I was thinking of redesigning my current backup solution to utilise it. Note that ...