Rsync is a fast and extraordinarily versatile file copying tool. It can copy locally, to/from another host over any remote shell, or to/from a remote rsync daemon

learn more… | top users | synonyms

0
votes
1answer
23 views

rsync taking 100% of CPU and hours to complete

So I have a pretty simple backup script that runs as a cron job every night and it is: rsync -azhv /company/shared_files/ /mnt/ext_drive/backups/shared_files/company_share_backup_"`date ...
-1
votes
1answer
24 views

pulling latest software version onto new server [on hold]

Currently, we have a cluster of around 60 machines. When we perform a software push, we push to a central distribution server, then use lsyncd/rsync to distribute the files to each machine in the ...
1
vote
2answers
37 views

rsync --iconv option on Mac not working (sync from remote Linux server to local Mac)

I want to use rsync to backup data from a remote Linux server to my local Mac. And I want to initialise this operation on my local Mac. All works fine except that there is a special character problem: ...
2
votes
2answers
90 views

Possibility of WAN Optimization for SSH traffic

While I do understand that SSH by itself is a very low bandwidth utilizing protocol, it is sometimes choking up bandwidth during peak hours in our office environment. I want to know if at all it is ...
1
vote
1answer
32 views

Rsync failing with “file too large”

I am writing what should be a simple backup script to copy all of my media files to an external USB drive. There seems to be one file that it chokes on and I'm not sure why. Just trying to copy that ...
4
votes
2answers
49 views

full or incremental backup of large number of files

I have a large amount of files in both quantity and total file size. (we're talking a few terabytes). I would like to sync these files/folders once to an external backup system, then run a daily task ...
-2
votes
1answer
33 views

Download your files from your dedicated server to synology [closed]

I'm trying to write a program/script to download files from my dedicated server (CPanel) to my Local synology. Ideally, I would like to sync it, but for now I'd rather just download. I found this ...
0
votes
1answer
38 views

Using hostname rather than IP address in /etc/rsyncd.conf not working

From what I understand from the rsync docs, I should be able to use a hostname with hosts allow. However, it does not work. This works: pid file = /var/run/rsyncd.pid syslog facility = rsync.log ...
1
vote
5answers
140 views

Automate and create SSH keys for large number(Nearly 9000) of servers for almost 30 users

Is there a way to automate to create SSH keys for large number(Nearly 9000) of servers for almost 30 users
0
votes
1answer
33 views

SVN Post Commit Issue (Calling Bash)

All, I would like to invoke a bash script (to do some rsync magic) towards the end of my post-commit hook. Here is what my post commit hook looks like: #!/bin/bash REPOS="$1" REV="$2" ...
0
votes
1answer
31 views

Sync Code Between EC2's [Rsync/SSH]

I have a variety of EC2 boxes inside an ELB, one of which is used for SVN exclusively. I currently have a script that gets called as part of the post-commit hook which is meant to sync files between ...
0
votes
1answer
31 views

Prevent rsync from changing ctime

I have the following scenario: I have files in one directory where there is a process that is changing some files and updating the ctime on all files. I want to rsync all files to a target directory ...
2
votes
1answer
77 views

rsync --link-dest not working over samba?

I'm trying to wrap my head around rsync behaviour when using --link-dest as my personal backup. My setup is a Mac Pro with a separate data partition which I want to backup to an ubuntu server. Trying ...
1
vote
3answers
67 views

rsync using keygen login in bash script

So I have set up a password-less ssh login for a server. I can run rsync from the command line, and it works beautifully, and doesn't ask me for a password: rsync -avz -e ssh myDir ...
0
votes
3answers
26 views

Can I use rsync to synchronise files in all directions?

I am setting up a webserver cluster and there is the facility for certain files to be uploaded. This can happen on any of the web nodes and I am trying to work out the best way to distribute the ...
0
votes
1answer
31 views

rsync backup remote server maintaining groups and owner

This might seem like a problem that should have been covered millions of times but I am running into issues that after days of scouring the net, I still can fix. I have a remote server that I want to ...
-1
votes
2answers
44 views

Is there a simple way to automatically send through scp any file modified in a folder to a remote folder? (one-way synchronization) [closed]

Put it simply: I have a folder full of files and subfolders with more files. I would like to have a mirror of that folder in a remote server so anytime a file is modified on my machine it gets ...
1
vote
0answers
23 views

Syncing rsnapshot backup drives

I have a pair of USB drives I use for backing up to via rsnapshot. One drive is left plugged in and the other is taken off site. For the first swap, I ran "rsync -aH" to copy all the contents from ...
0
votes
0answers
36 views

rsync hanging on local copy

I've inherited a system for moving ("promoting") content from one django instance (staging) to another (production). I'm testing a bit of new functionality in another part of the app, and want to make ...
4
votes
1answer
67 views

Preserving existing destination symlinks with rsync

I am using rsync to keep a local debian repository updated. Recently, the disk I am using to store it started running low on space, so I decided to use symlinks to allow me to move some of the ...
-1
votes
2answers
72 views

Is rsync more robust than scp for connection reset?

On a big corporate firewall-ridden network, we have traditionally used scp to copy a few brand new files over from one machine to another, as part of the log-file rotation and analysis routine. ...
1
vote
1answer
18 views

Why rsync still tries to copy and complains not enough space?

I am using rsync to copy one big file (> 4 GB) from hard disk to usb drive with "-av --progress" option. Before that, the file already exists on the usb and is the same as the one on disk. So ...
0
votes
1answer
95 views

rsync fails - No space left on device (28)

I want to backup ~5 GB of photos from one server to another. Rsync downloads about 80% of all files and then synchronization fails: rsync: write failed on "/var/www/sync/3655467597474553464543.jpg": ...
5
votes
1answer
129 views

Rsync + public key authentication security

I have read several articles how to automatically backup files with Rsync and public key authentication. All of them are very similar. I just finished setting up everything and everything works fine ...
0
votes
1answer
39 views

Rsync exclude wildcard files from the filter file

I have noticed that rsync have --exclude=PATTERN exclude files matching PATTERN --exclude-from=FILE read exclude patterns from FILE switches, but couldn't I just exclude files ...
0
votes
2answers
36 views

Prevent Rsync and SCP from causing page timeouts on LAMP server

I'm trying to run Rsync to move static files from our Dedicated server to our new cloud server. The following command works but when it runs it is stopping any web pages being served rsync -azP ...
1
vote
2answers
25 views

rsync link-destination remote server

I have a folder on a local machine and want to rsync to a folder on a remote machine. I would like to evaluate the copy against a folder on the remote machine --link-dest. The target directory will ...
-1
votes
1answer
148 views

Rsync hangs when transfering large files on an bad connection

've been having problems transferring files over a pretty bad connection (I'm trying to upload a file on a cloud server) via rsync. The rsync essentially hangs after about a minute or so. This is the ...
1
vote
1answer
49 views

Trying to install rSync 3.x on debian 4 etch

Whenver i use the official debian source link, and run the apt-get install rsync Debian automatically install me the rsync version 2.6.9. I can confirm with the following command : rsync ...
0
votes
0answers
273 views

What is the best way to backup and restore a CentOS 7 server, using rsnapshot?

I recently made a backup of a CentOS 7 server using rsnapshot - version 1.3.1 and rsync -version 3.0.9 I made a few changes to the rsnapshot.conf file, which are listed below. I uncommented the ...
0
votes
0answers
23 views

Remotly syncing NAS behind routers I don't have access to

We have several NAS (WD My Could Mirror) that travels to multiple cities and are fed locally with images, audio, video, etc. This content needs to be synced to our main office. I am trying to use ...
2
votes
2answers
105 views

RSync stalls after 32768 bytes

I have an issue which I am struggling to understand. I have a server which is hosted by a business parter on their network but my team is responsible for installing and configuring software to this ...
1
vote
1answer
55 views

rsync over ssh issue

I RTFMed rsync to the bone, but I just cannot figure out what I'm doing wrong here. I'm trying to sync two folders across SSH. Folders are identical save for one file, as you can see here: ...
1
vote
1answer
28 views

Do different rsnapshot retains use the same hard links?

Say I have a weekly and monthly backup configured in rsnapshot. Will the weekly backups create hard links to the same files created by a previous monthly backup (and vice versa)?
1
vote
2answers
265 views

Can I use rsync to create a list of only changed files?

I am using rsync in a bash script to keep files in sync between a few servers and a NAS. One issue I have run into is trying to generate a list of the files that have changed from the during the ...
0
votes
2answers
86 views

rsync IMAP SENT folders between 2 users

How can I handle this: We have a Email system based on DOVECOT IMAP, different users, different logins. I want to somehow rsync all sent folders of some users, so one user can check what another ...
0
votes
1answer
105 views

rsync ESXI 5.5 out of memory in receive_sums [duplicate]

I statically compiled the latest rsync (3.1.1) & can successfully execute the command on my ESXI server. I am getting the following error from rsync however: ERROR: out of memory in receive_sums ...
0
votes
1answer
53 views

Leveraging rsync for a local copy between two slow drives, benefits without a daemon

I am confused by the benefits of rsync (3.1.1) if there is no daemon running remotely, e.g. copying from a drive mounted via SMB2 (via a VPN) to an external HDD (USB 2.0, sadly). Both connections are ...
0
votes
1answer
117 views

Synchronizing Files between Ubuntu and Windows Server

I have a Ubuntu Server 12.4 LTS with Samba Share and I would like to synchronize my all Folders in the shared folder to the Windows Server (Win2k8R2). So Far I have used Lucky Back up, Freesync and ...
0
votes
1answer
19 views

Rsync Exclude Remote

I try to synchronize content back to a remote server with the difference that server has a new /home/virtual folder what I don't want to touch: rsync -avz --numeric-ids --fake-super --delete ...
-1
votes
2answers
125 views

chown during rsync from windows to unix

rsync: --groupmap=*:www-data: unknown option I am trying to add an option to my rsync line to set the group of the files transfered to have www-data as their group. When i add the option i get ...
-1
votes
1answer
62 views

windows rsync from different local drive, other than c, to remote

rsync -avz D:/test me@my.server.com:/test I am using cwrsync on a windows7 box rsyncing to a linux box. Everything works fine when i am going from a relative path on drive C.. but i need to rsync ...
3
votes
2answers
147 views

BackupPC Taking over 72 hours to backup 250GB's

I am using BackupPC to backup some workstations at the office. One workstations in particular has a sizable amount of data when compared to the rest, however, it's not that large in general (talking ...
1
vote
1answer
86 views

How do I properly escape an rsync exclude pattern used in a bash script?

Script: #!/bin/bash site=$1 remote_host=$2 new_site=${3:-$1} cmd="rsync -rlpuvz -e ssh /www/$site/ $remote_host:/www/$new_site --force --delete --exclude=\"site/web_sitemap_*.xml.gz\"" echo $cmd ...
1
vote
0answers
98 views

rsync chgrp Failing on NFS

I am trying to set up NFS on two servers to share files. The owner of the files in question have the same UID and GID on NFS Server and each NFS client. The NFS Server is running on Ubuntu 14.04 and ...
2
votes
3answers
206 views

Should I use rsync compression over a gigabit LAN?

I normally use rsync's -z option to enable compression when transferring files over the internet. However, if I am on my own (idle) gigabit LAN, do I still want compression? Or will it be faster ...
15
votes
2answers
999 views

Does Rsync Allow Files To Be Synced Both Ways?

I have backed up a linux web server using rsync with cygwin. I now have a perfect copy of the server on my windows laptop. If i delete or modify a file on my laptop and run rsync again with cygwin ...
1
vote
1answer
58 views

rsync not deleting Folders in destination

I know there are some questings with the same topic here but no answers helped me. First, this is my script. It should copy all files from the source to the destination (preserving all rights, etc). ...
0
votes
2answers
147 views

Backup Ubuntu server with cron/rsync: Problems with resuming large files

I currently have a dedicated Ubuntu backup server which wakes itself up from suspend (using rtcwake) daily. 5 minutes later a cron BASH job kicks in, using rsync to pull files from various network ...
1
vote
1answer
311 views

How to sync SVN repository with a remote FTP filesystem

I configured a Centos server locally(in-office) which contains a SVN repository with a project. Many developers are working on this repository and making changes. Also I have a remote server which ...