Rsync is a fast and extraordinarily versatile file copying tool. It can copy locally, to/from another host over any remote shell, or to/from a remote rsync daemon. It offers a large number of options that control every aspect of its behavior and permit very flexible specification of the set of files ...
1
vote
4answers
60 views
Keeping Files Synced Across Two Servers
I have setup a web server running nginx and another server running php-fpm on Linode VMs. Nginx proxies all PHP requests off to the PHP backend and this works great.
The problem, is that the actual ...
1
vote
1answer
32 views
What is the default remote shell for rsync?
Just curious, what is the default remote shell used by rsync when you're not using it in daemon mode? According to the man page it can be run via rsh or ssh. However nowhere in the man page does it ...
1
vote
1answer
25 views
ssh from username1@client to host using username2@destination
Forgive the possibly simple question, but I cannot seem to find a good solution.
A backup job needs to rsync files to a destination host, over ssh. The only login available to me is ...
0
votes
1answer
58 views
installing rsync stops with error in subprocess
I tried to install rsync on my vserver which is running on Debian Squeeze.
After calling apt-get install rsync the installer stops working with the following output:
$ apt-get install rsync
Reading ...
2
votes
3answers
70 views
Mirroring an entire machine
What's the most appropriate way to constantly mirror all the settings and data from one Linux machine to another? I have a critical server, which I'd like to have a "hot spare" available for in case ...
-2
votes
2answers
45 views
rsync error: unexplained error (code 130) at rsync.c(541) [Receiver=3.0.7]
I have been getting the follow error when trying to rsync from one server to a remote server:
rsync error: unexplained error (code 130) at rsync.c(541) [Receiver=3.0.7]
The server configurations are ...
7
votes
2answers
67 views
btrfs-enabled backup solution
With btrfs hitting production in Oracle EL 14th this month (together with working fsck and scrubbing from Linux 3.2) I was thinking of redesigning my current backup solution to utilise it. Note that ...
0
votes
1answer
25 views
rsync and bash command substitution
Trying to get a script to properly make use of variables. (The below examples are on the command line but I see the exact same behavior when inside a #!/bin/bash script.
$ FLAGS='--rsh="ssh -2"'
$ ...
0
votes
3answers
65 views
moving files between linux servers via shell script
What method is the most script-friendly for moving files between servers?
The only methods I know of are SSH and rsync, but I don't want to jump into them if there is something else that is a ...
0
votes
0answers
13 views
Synching test unit
As part of this post I was advised to use Unison to keep 2 working copies of the same directory in sync. Since this is intended at a production environment with a certain amount of data (4.5GB) I want ...
0
votes
5answers
66 views
Synching 2 remote folders
We have 2 Drupal servers that read/write to their own copy of the same folder (the sites/default/files folder for those of you who know a bit about Drupal). Those 2 folders should be in sync. I've ...
1
vote
1answer
41 views
rsync permission problems
First, I know that it was discussed before but I cannot seem to find a reliable solution for this...
I have CentOS 5 with Plesk panel on my remote server where I have sites that need to be backed up. ...
0
votes
1answer
45 views
rsync vdi's to local cifs mount for backup but prevent -w option?
I'm dumping my vdi's over to a mounted cifs nas just for backup . rsync seems to think is is local so it just copies the whole 6 gig file again rather than differences. Can I suppress this behavior ...
3
votes
1answer
29 views
rsync to adapt links that have absolute paths to the location at destination
Would it be possible with rsync to adapt the absolute, symbolic links to a new location at the destination?
Test case
Imagine I have a link pointing to a file like this:
...
2
votes
3answers
122 views
How to avoid the Load in rsync with ssh?
I having an large amount of data (300GB) in an Linux server. Now, i want to transfer to another Linux server using the rsync over ssh. When i transferring the data it creating huge load in the server. ...
1
vote
2answers
52 views
Odd rsync issue - duplicating and uncompressing files
I have two servers: our production web server(freebsd) and a backup server(centos). The production server does mysql database dumps every 3 hours and compresses the dump file using bzip2. So we have a ...
1
vote
2answers
71 views
Git-style incremental backup with rsync
I'm trying to setup a backup script on Ubuntu. Every day I want to copy my local source directory to a backup directory on a remote server uniquely named with the date. (e.g., backup-jan1/, ...
1
vote
1answer
95 views
rsync sub-trees that have a certain name?
Hoping this is the right place to ask this...
I have a directory tree like this:
r/a/src/etc...
r/a/target/etc...
r/a/xyz/etc...
r/b/src/etc...
r/b/target/etc...
r/c/src/etc...
r/c/target/etc...
...
-1
votes
1answer
67 views
Dreamhost SSH activity now ip is blacklisted [closed]
I think that dreamhost blacklisted my ip address. I am giving this assumption due to the fact that I can not visit any of the hosted sites on the dreamhost server (namor). I also still have an ...
2
votes
1answer
71 views
Rsync over SSHFS hangs
I have sshfs setup to connect to another system (Rackspace Cloud Sites) that I don't have ssh access to (but for some reason I can use sshfs? Go figure). I'm attempting to rsync files from the sshfs ...
0
votes
2answers
40 views
Running rsync doesn't give desired results
I have a linux box that has a Windows 7 share mounted. The Linux box has a cron job to copy the contents of the Win7 share to another location on the Linux box -- a backup.
The script run is simply ...
1
vote
1answer
22 views
Rsync and RDNS won't backup?
Hi I've got a problem trying to Rsync a backup to another server.
I get the error
Address xxxxxxx maps to xxxxxxx, but this does not map back to the address - POSSIBLE BREAK-IN ATTEMPT!
The first ...
0
votes
1answer
36 views
Load balancing web/ftp servers with rsync
With the setup of several VPS/Dedicated servers which are identical to load-balance. How would I go about making sure all the code is the same?
Recently I've read up about rsync. Not 100% sure what ...
1
vote
4answers
111 views
Looking for suitable backup solution Mac OS X to offsite Centos 6 server 1TB of working data
I'll start by saying what we have in place currently:
On site file server (Mac OS X Server) that is used by GFX designers and they have a working 1TB of data.
Offsite server with 2TB available ...
2
votes
2answers
71 views
Copy whole files only
Is there any way to copy directory from one filesystem to another but remove the partial file in case we run out of disk space on target filesystem?
I searched cp and rsync manuals but did not find ...
0
votes
1answer
59 views
How to add timestamp and file list to rsync log?
I want to add both timestamp and file list to the log. Currently, I can only get one. The following command to can track the updated file list but it does not add timestamp.
rsync -avz --progress ...
1
vote
2answers
48 views
Permission denied for many directories with Rsync
I'm using Rsync to backup an Ubuntu Server server. I'm getting a lot of permission denied messages. Is there a command I can use to see exactly what directories were denied? I could scroll back up ...
1
vote
4answers
80 views
Rsync command for offsite rolling backups
I've read alot of articles and tried to come up my self but couldn't, so need help with Rsync command for offsite rolling backups please.
I have installed cwRsync(in VMs as a test run for now) on two ...
1
vote
3answers
55 views
Rsync : copying over timestamps only
Currently I have two directories A/ and B/ which are identical in every respect, with the exception of the timestamps. Therefore if I run the command :
rsync --dry-run -crvv A/ B/
then all files ...
1
vote
1answer
140 views
ssh, rsync and does not map back error
I'm trying to rsync data between Amazon EC2 instances.
This command works:
ssh -i path_to_key/key.pem user@machine1
This command does not:
rsync -e "ssh -i path_to_key/key.pem" ...
7
votes
2answers
115 views
Which is better for website backup - rsync or git push
I run 2 LAMP web servers at different providers for disaster recovery purposes - a high powered live server, and a low powered backup server.
Currently I rsync all the data from the live server to ...
1
vote
1answer
68 views
Rsync from CIFS mounted Windows shares is slow. Why is this? Are there alternatives for file copy with checksum support?
I have found that using Rsync to transfer files from CIFS mounted shares resident on a Widnows client is extremly slow.
I have read a few threads here on SF, and several other forum posts on the web, ...
0
votes
1answer
82 views
Rsync and Webmin won't recognize a change in ports
I am trying to use Rsync to transfer files between servers. However, I used a nonstandard port on one of the servers. This caused trouble, so I changed the port back to 22. Now, when I try to use ...
0
votes
0answers
45 views
Rsync receives incremental file list, but doesn't transfer
I am trying to use Rsync to transfer files between two servers. Rsync builds the incremental file list, but doesn't transfer anything. I am using Ubuntu Server on both machines. I am using the ...
2
votes
2answers
60 views
Rsync with ssh-keygen to ssh user with limited commands and specifc directory
i have two machines
local machine
remote machine
i want to backup my files and folders automatically to the remote machine and doing that by Rsync command for transfer files and folder using ...
0
votes
1answer
50 views
Rsync without password and different port to rssh shell
i was trying to Rsync without password to rssh shell using
ssh-keygen
and
ssh-copy-id -i /root/.ssh/id_rsa.pub '-p 12345 user@example'
but i couldn't got the following message
This account ...
1
vote
1answer
49 views
How safe is rsync --remove-source-files?
I want to move some files using rsync, but it's vital that the files are intact at the destination before removing the source files. The thing is, I can't find any information telling me how rsync ...
1
vote
2answers
83 views
Permission Denied Error when Using RSync to Copy Directory/Files from Ubuntu to RHEL Servers
I'm attempting to use rsync on a new RHEL server to copy files/directory from a remote Ubuntu server. I used rsync -avx remote@host.com:/var/www/ /var/www/html
I'm then prompted for the password for ...
1
vote
1answer
40 views
rsync include/exclude directories
I need to sync from this directories list only the web directory. I am using a debian distro and the rsnapshot with rsync protocol for the transfer of the data.
clients
├── client3
│ ├── site1.eu ...
1
vote
4answers
117 views
How to backup a server directory remotely?
I am trying to create a backup of a remote server. This is my configuration:
Server1 (webserver)
Server2 (backupserver)
This is my little script. It starts from the server2:
#!/bin/bash
...
0
votes
2answers
100 views
ssh keyfile and rsync not working
if created a keyfile for my user to sync two linux server via a cronjob and rsync but right now I've got a problem.
I'm using a keyfile but i don't get no errors on connect but its still prompting me ...
1
vote
2answers
39 views
How To Setup A Centralized Repo To Distribute Files To Servers
Assume I have dozens, even hundreds of servers. What is the best method of pushing a central copy of files to a given directory to all servers? Example, we update a bash script, and put it on a ...
3
votes
2answers
38 views
Remote to Remote File Sync without direct network connectivity between remote servers
I would like to set up a task to sync 2 remote servers' files.
Historically I performed the following:
SSH to Destination
SU to user which has public key on Source
Rsync over SSH to pull files to ...
2
votes
3answers
227 views
How to copy large (> 1 million) number of small files between two servers
I need to migrate about 1TB of data comprised of smaller files (most under 100KB) to another server. I've not even completely enumerated the files but estimates are between 1-2 million.
The ...
1
vote
1answer
27 views
rsync: safely recovering a previous failed rsync when using --remove-source-files --ignore-existing
I have this daily archiving job
rsync -a --ignore-existing --remove-source-files src dst
The intent is to copy files to an archive and remove them from the source when done.
I have one very ...
2
votes
3answers
109 views
How can I automatically sync files on my CentOS VM?
I have to keep copying files over from my ~/src to /home/httpd directory, which is a pain when I'm making front end changes. Is there a way I can have changed files sync automagically? -- and ...
0
votes
0answers
24 views
rsync on windows, client not connecting
I have a windows xp pro, it's the test machine, before copying the rsync program on the win 2003 server.
I found this free rsync ported to win32 :
rsync version 2.6.3 protocol version 28
Copyright ...
0
votes
2answers
65 views
How to use rsync to copy images and dir
I am in the middle of merging 2 directories into 1.
/competitions/1
/competitions/2
/competitions/3
/gallery/1
/gallery/2
/gallery/3
I want to copy all the files in /competitions to /gallery and ...
0
votes
0answers
100 views
Rsync and lsyncd error
I am on Amazon EC2 and trying to sync two directories(/var/www/html) on my instance together with lsyncd but I am receiving this error in the log:
rsync: connection unexpectedly closed (0 bytes ...
0
votes
1answer
59 views
rsync file list over ssh generated by remote script
for f in `ssh $SSHCRED "~/file-list.sh"`
do
rsync --progress --times --partial --append --rsh=ssh -r -h --remove-sent-files $SSHCRED:$f $OUTDIR
done
This is what I do today.
I'd like to instead ...
