Rsync is a fast and extraordinarily versatile file copying tool. It can copy locally, to/from another host over any remote shell, or to/from a remote rsync daemon

learn more… | top users | synonyms

-4
votes
3answers
1k views

rsync over ssh to esxi

I try to backup esxi via rsync over ssh. I run rsyc but I get error: # rsync -e ssh -av root@ip.esxi:file.txt . sh: rsync: not found rsync: connection unexpectedly closed (0 bytes received so far) ...
0
votes
2answers
261 views

What is the best way to transfer large amount of small files from 1 Windows Server to another over the internet? [closed]

I'm trying to one way sync around 100,000 small files for a total of 2GB from a server located in my office to a web server. I'm using Syncrify with some success but the scheduling feature does not ...
1
vote
2answers
975 views

mounting windows shares on linux while keeping windows permissions

I have a windows share on a windows2003 server (WINJOE) which I want to back up to a Linux machine (LINUXJOE) that is properly joined to the domain. My goal is to backup shared folders of WINJOE to ...
3
votes
1answer
1k views

Can't get rsync over sftp to work

I'm trying to set up a backup system from an Ubuntu server to a Synology NAS (DS413j) using rsync and sftp. I have created a user for this that we can call ubuntu-backup. I have a directory in ...
9
votes
1answer
1k views

Why does rsync spawn multiple processes for me?

I am using the following cron statement to backup from one folder to another folder in the same machine: 19 21 * * * root rsync -ac --delete /source/folder /dest/folder When I use pstree, I see ...
-1
votes
1answer
285 views

Run totally silent rsync?

I have a cronjob that runs hourly, and is totally silent unless something goes wrong. Well ... almost ... A part of the job is rsync --del -Cacqrz public/. user@host.example.com:/target/path This ...
0
votes
1answer
177 views

Is there a way to synchronize my distributed storage infrastructure with file changes possible on each location? [closed]

I need a storage device in 3 different location. Each device will have 4TB of storage. At least 2TB should be a 'shared folder' working like Dropbox: when a user change a file in one location, the ...
0
votes
2answers
89 views

Rsync for generating daily backups, with some sort of history

this is probably expanding on Using Rsync to backup to an external drive I usually, manually, back up my data to an external drive. I start by creating a directory on the external drive with today's ...
0
votes
3answers
129 views

How to use `rsync` to securely push to a mirror?

I am using rsync --rsh "ssh" to push to a mirror. Setting the necessary file system permissions on the mirror requires rsync to run with root privileges on the mirror. However, the mirrored files ...
1
vote
1answer
114 views

Rsync - Recursively Include Few of Many Folders in One Statement

For the sake of this post, lets assume I have a folder called "misc" that has 100 sub-folder named 001 to 100. Each folder has many sub-folders and files. I want to write one rsync command that ...
0
votes
1answer
302 views

Copy Files/Folders on Windows Volumes Created from Mac

We are trying to migrate storage from one volume to another, and we are running into problems with folders and files created from Mac OSX. The current file storage is on windows, and unfortunately ...
0
votes
1answer
211 views

How Can I Automate Windows Rsync to Linux NAS?

Here's the scenario: (2) Windows servers in an office Server 1. Application Server Server 2. Backup Server, PDC, DNS (5) Laptops that backup to the backup server The Backup server has Symantec ...
0
votes
2answers
1k views

How to rsync files / folders from a specific date forward?

I would like to rsync folders from a specific date and forward. for example. I want to rsync my folders that were created from 3 days ago (and of course 2 days ago, one day ago etc.). I know I need to ...
2
votes
1answer
138 views

Is it safe to rsync the same source to the same destination in parallel

My application use rsync to copy files from network driver to local as cache to improve performance. But since my application might be run in parallel, so as the rsync, and there could be a case that ...
0
votes
2answers
1k views

Rsync transfer via SSH is very slow

I am making a remote backup of my website. Whole catalog is about 70GB with about 5,000,000 of files total. Here is the command that I run on my backup server: rsync -ah -e ssh --delete ...
2
votes
3answers
155 views

Rsync-like file transfer with no rsyncd or sshd on remote end

I need to transfer and then update a directory structure from a linux host in my network to another linux host in a customer network. My only access to the customer network is through a Citrix ...
1
vote
1answer
1k views

rsync unexplained error & received SIGINT, SIGTERM, or SIGHUP

I created a batch script to back-up our server: #!/bin/bash user=$1 # create user dir ssh root@local.backup.tst -p 5774 mkdir -p /var/backup/server.tst/incremental/$user # backup mail dir rsync ...
0
votes
1answer
77 views

Detect running rsync session

I have a remote system, over which I don't have any control, uploading a lot of files over rsync/ssh from time to time. After that I need to process the files. But I can't touch incomplete copy. How ...
0
votes
1answer
133 views

Rsync filter and ignore some directories

I'd like to rsync a directory that contains a Python 3 app on my server. The directory has files I'm interested in: the files that end with .py And there are the files I'd like to be ignored (these ...
2
votes
3answers
1k views

Rsync over SSH getting no tty present

I'm using the following command in root's crontab on Debian. rsync -vqrlHEAXogDtzhi --log-file=${LOG} --progress --rsync-path="sudo /usr/bin/rsync" --exclude-from=$CONFIG_DIR/excludes -e "ssh -i ...
0
votes
2answers
215 views

How to run rsync without staying logged in?

I want to run the following rsync command to transfer a folder from a remote server to my current one sudo -r -a -v -e 'ssh -p portnum' username@serverip:/home/path/* /home/path this directory is ...
0
votes
1answer
86 views

Rsyncable Snappy?

I have some massive Cassandra clusters that I'm maintaining on EC2. Backups offsite take a long time as the snapshots have to be tar-ed and gzip-ed and pushed over the network from the EC2 instance ...
0
votes
1answer
38 views

rsync secure configuration running as daemon

The uid is set to nobody (which should be default anyway), chroot and read only are both enabled. The rsync service is being started over /etc/init.d/rsync. This is the full rsrync.conf: motd file = ...
0
votes
2answers
122 views

rsync in daemon mode: preserve absolute directory structure

I am trying to backup some folders with rsync launched on daemon mode. Basically the client launch this command: rsync --delete -avz -R -e "ssh -i ${KEY}" ${SERVER}::${MODULE} {DST_DIR} the ...
2
votes
3answers
268 views

rsync pull disregards my umask, why?

My umask is 0002. So when I rsync -r me@remote:new ., why aren't the results group-writable? drwxrwsr-x 10 root developers 4096 Aug 22 12:55 . drwxrwsr-x 12 root developers 4096 Jul 14 ...
1
vote
2answers
1k views

Reconstructing cyrus mailboxes with sub-folders

I have a mail server which runs Cyrus-imapd and postfix. I have another server which is to be the backup mail server. I have rsynced one mailbox from the primary server to the backup server to test. ...
1
vote
1answer
82 views

Some files are not transferred by using rsync between 2 servers

I used rsync with -av parameter to migrate a website from one server to another. there was no error displayed but the size of the folders are not the same and the website does not work correctly. so ...
1
vote
2answers
96 views

Selectively synchronize files to multiple servers

I'm administering a medium sized AIX landscape. We have, probably... 40 systems. We are currently using AIX 6.1 which has a command called cfmupdatenode. What this program does is lets you define a ...
1
vote
1answer
142 views

Rsync not working with one server while it does with others using strato hidrive

On a CentOS 6.4 running linux server, I am trying to rsync a folder with strato hidrive (http://www.strato-hosting.co.uk/online-storage-hidrive/advanced/). The server is running rsync version 3.0.9. ...
3
votes
1answer
963 views

Linux server sync to an Amazon S3 bucket

I am looking for a stable solution to replace a classic server backup to another server using rsync. I have to sync a whole filesystem (more than 1Tb) to Amazon S3. Where am I? Solution 1: I mapped ...
4
votes
2answers
4k views

Rsync creates a directory with the same name inside of destination directory

When I run this command rsync -avzp --del -e "ssh -p myport" user@hostname:/var/www/tests /var/www/tests files get synchronized but instead of saving files in /var/www/tests, Rsync creates one more ...
8
votes
1answer
285 views

How to cleanup after failed rsync?

I killed a local "rsync -ah" process. It left junk files like ".abc.vmdk.zxivMN" in the target directory. The junk files do not get deleted on consecutive "rsync -ah" runs. Details: I ran diff on ...
0
votes
2answers
89 views

RSync on Windows including only certain folders

We use rsync to transfer IIS logfiles from our web servers to our analytic server. There are many folders which are currently all being transferred and we now only need certain folders to be ...
3
votes
1answer
657 views

rsync connection closing right around an hour

I am running some command in cron that does an rsync over two data centers. The connection rate between the data centers is around 1Mbps. I noticed that rsync keeps failing around 2.7GB to 2.9GB of ...
2
votes
1answer
708 views

Can I make rsync output summary only?

Because I use rsync to backup a directory which is very big, containing many sub-dirs and files, so I dont want to see the "incremental file list", I want to know the summary in the end only. but if I ...
0
votes
2answers
106 views

Why doesn't rsync over ssh work when placed inside a FOR loop in a batch file?

I've placed the ff. code in rsync.bat: for %%A in (%VAR_REMOTE_HOST%) do ( set VAR_TARGET=%USER%@%%A:%VAR_TARGET_DIR% echo Rsync Source Dir: %VAR_SOURCE% setlocal ENABLEDELAYEDEXPANSION echo ...
1
vote
1answer
498 views

Restore file permissions after rsync on ntfs

When messing around with partitions under Windows when I tried to format empty space of the hard drive to have it in Windows, I messed something up and cfdisk told me that all the partitions did not ...
0
votes
1answer
179 views

BackupPC and rsync, disabling checks on date modified with --size-only not working for Lotus Domino mail archives

We have a BackupPC server that is supposed to be backing up a Lotus Domino 9 server, both on Ubuntu 12.04 64-bit with rsync 3.0.9. Our Domino server is set to archive e-mail messages that are older ...
3
votes
1answer
385 views

rsync copying entire files instead of difference

I have 2 remote folder containing few files. I am using rsync to sync the 2. The thing is that on the first server files are strictly just APPENDED with new data every day. When I call rsync it seems ...
2
votes
1answer
566 views

ssh connection operation timed out using rsync

I use rsync to backup my remote server on my local device but when I combine it with a cron job my ssh times out. Just to be clear, the data is stored on a remote server and I want it stored on my ...
3
votes
1answer
266 views

Linux bidirectional file sync over a WAN with immediate/incremental syncing

Does anyone know of a solution that lets you sync files bidirectionally over a WAN, but also syncs immediately/incrementally? Basically Unison is perfect for the file syncing, but it doesn't sync ...
1
vote
1answer
270 views

Cloning OpenVZ container

I have an OpenVZ container on 1 host and I would like to clone it over to my server. both run SolusVM. I only have root access to my server and would like to host the container on my server now. Can ...
2
votes
1answer
100 views

Very different results from df after a few seconds

When the backup moves the files from one server to the other the results from df change every few seconds in an impossible manner. The source host is running rsync. On the destination host I'm running ...
1
vote
0answers
111 views

Trying to script rsync using pam_exec

I'm trying to write a bash script that will execute rsync when called by pam_exec. I've tried a couple different ways, and I'm not sure what I'm doing wrong. When I try to run the script at login by ...
0
votes
2answers
50 views

What upload technology would be appropriate for this use case?

My department does data migrations when a client switches from another software vendor to us, often we need to get a copy of their old data (whatever that may have been) and send it to us. The big ...
0
votes
1answer
117 views

How can you do dynamic, key-based SSH similar to GitHub?

I wan't to provide SSH/RSYNC like features to users of my app. I'd like them to just be able to paste/save an SSH key into my app similar to how GitHub does: So, my question is, once I let users ...
0
votes
1answer
129 views

FreeNAS - how to “Exclude from file” in Rsyncd (GUI)

I am trying to set rsync tasks to Pull user profiles from 11 Windows machines running DeltaCopy Server and then configure ZFS periodic snapshot tasks for a backup solution. So far this has been ...
0
votes
1answer
58 views

Is is possible for rsync to partly copy a file, if a process gets killed?

My assumption about rsync is that it transfers the file in a "sync"hronous way, meaning that it's all-or-nothing. Is this correct, or is it possible that rsync could return a non-0 and still have ...
2
votes
1answer
718 views

easy way to restore incremental rsync backup?

I have incremental rsync backups of a folder, created with: rsync --delete -a -v --backup --backup-dir="../backup_`date +%Y-%m-%d`" /orig /backups/dest so I have a copy of current /orig on ...
1
vote
1answer
116 views

How do you setup an rsync server and client?

I have worked on rsync for the whole afternoon. I have set a rsync server,but I don't know how to use it. I have two machines:66 and 12. 66 is the server,I want to back 66's data to 12,so I use ...