Rsync is a fast and extraordinarily versatile file copying tool. It can copy locally, to/from another host over any remote shell, or to/from a remote rsync daemon
1
vote
1answer
257 views
Backup with rsync makes the server unresponsive
Setup:
I would like to backup 1 TB on a weekly basis from PROD to BACKUP server.
The servers run under Linux Ubuntu-1004-lucid-64-minimal 2.6.32-35-server.
There is the BACKUP server (where I start ...
-2
votes
2answers
113 views
Linux - Copy directory between server using rsync [closed]
I want to copy directory foo from server A to server B.
what is the way to do it using rsync?
foo is a large directory so I need the copy will be fastest as possible.
Thank!
0
votes
0answers
178 views
Taking a server snapshot for a Linux backup server
Is there a way to take a 'snapshot' of sorts and have my backup server mirror my live server, as a sort of testing environment? I know I've seen a lot of answers saying to use rsync. I'm not sure if ...
1
vote
2answers
263 views
RSYNC for Incremental backup takes 3+ days
I've built an incremental backup solution which uses RSYNC to backup a few of our servers. I'm using PHP to run through config files to get the information for each server that needs to be backed up. ...
0
votes
1answer
83 views
Backup tools detecting relocated files [closed]
Currently my favorite backup tool for my needs is rsnapshot. The only downside is the space wasted if files are just relocated. I have seen a similar question at severfault, but the author tried to ...
0
votes
3answers
286 views
rsync or scp only if there's a difference
How do i figure out if there's a difference between an backupfile and the current used one.
The Filename of the Backup is named like: filename_date.conf
and the currend used one is name like: ...
2
votes
1answer
205 views
Rsyncing VPS's “/” directory to an external drive: Good backup solution?
I have a VPS with Debian 6 (squeeze) and want to back it up on an external drive at home, so that in case of failure I can restore the complete operating system with all software, settings and ...
4
votes
1answer
217 views
bind interface for upload : scp works, not rsync
I need to upload file on a specific interface.
This cannot be set-up via iptables, because my script output on several interfaces.
this is working fine :
scp -oBindAddress=192.168.100.1 ...
but
...
1
vote
1answer
222 views
Run scripts on user login, but before session (Linux)?
Does anyone know of a way to do the following on Linux. I can't seem to find a way to run a script after the user is authenticated, but before the session starts...
User types username and password ...
3
votes
1answer
135 views
rsync flagging files that are the same exact for timestamp
When I do rsync --dry-run -rv, rsync is listing files that are identical except for their timestamps.
My understanding was that with just these flags (which don't really change the comparison ...
0
votes
2answers
328 views
rsync permission errors on smbfs share
I have a nas set up an am trying to rsync files to it. It works fine for file I own
$ id dogmatic69
uid=1000(dogmatic69) gid=1000(dogmatic69) ...
1
vote
1answer
193 views
How do I get rsync to listen on two different ports via xinetd?
I have multiple servers that receive files via rsync on different ports. I'd like to merge them into the same physical server and let the clients continue to direct their files to the same port they ...
0
votes
2answers
108 views
Need an alerting system if my cloning script fails [duplicate]
Possible Duplicate:
How to repeatedly call rsync until files are sucessfully transferred
I've configured a nightly rsync to mirror one server to a standby offsite backup server. The total ...
0
votes
1answer
666 views
Elastix, how to MOVE files from one server to other server?
In my office, i have to schedule for moving a file from one computer to other computer (Both are using Elastix).
My idea is using cron, scp, and rm to do this. So here are the script that i use:
scp ...
0
votes
1answer
154 views
rsync (or robocopy) from multiple computers - what happens?
If a Linux server has two different rsync jobs nightly for the same folder to two different destinations, do both destinations end up with the same end set of files? Or does the first job run, and ...
0
votes
2answers
191 views
Clone a Red Hat RAID as part of a disaster recovery plan
I am looking for recommendations to clone a Red Hat mirrored raid to a single hard drive located in the same machine. The idea is if the servers hardware ever has an issue we have a similar hardware ...
0
votes
2answers
96 views
Debian mirror syncing error
I'm running the Debian mirror syncing tool 'ftpsync' on a FreeBSD 8.2 system. I changed the script a bit only to adapt to the FreeBSD system (e.g., path of bash). And I followed the steps from ...
-5
votes
3answers
107 views
Need to Transfer 390 GB of Data from Linux Server to Windows Machine [closed]
We want to transfer 300+ GB of data from a Linux Server to a WIndows Server.
Can we use rsync (and if so, how would we?) to copy the files from the linux server to the windows file share?
Or should ...
-2
votes
2answers
415 views
File replication program for Linux
For my disaster recovery plan I am looking for a free/open source file replication program which could copy all files including open/busy files to a remote server. Would appreciate any suggestions or ...
2
votes
2answers
365 views
How do I reserve bandwidth for rsync?
Currently nginx uses all my bandwidth. How do I leave some for rsync?
0
votes
1answer
91 views
rsync does't work
I set up a new ec2 ubuntu server and I'm unable to use rsync to push a file up. I can ssh to the machine with my keypair. I'm not sure why this looks like it works but finishes in half a second and ...
0
votes
2answers
178 views
rsync to ONLY keep files in destination that have been removed from source
We use rsync to copy filesystem contents from one machine to another as a backup.
We first run MACHINE-X->MACHINE-Y rsync for a straight backup with the --delete and --delete-excluded switches
We also ...
3
votes
3answers
205 views
rsync --link-dest behaviour when run as sudo
In order to create regular backups, I'm using rsync together with --link-dest so as to create hard-links for unchanged files. For example:
rsync -ax \
--partial --delete --delete-excluded ...
1
vote
3answers
160 views
rsync - report only uploaded files
I have a problem with rsync: either it shows me all files in the directories I am rsyncing (if using the flag -v) or nothing at all (when not using -v).
I would like to have rsync quiet except for ...
1
vote
0answers
152 views
rdiff-backup not working, but rsync is,Mandriva for both OS
I have two servers, both Mandriva 2010.2, have exact same version of rdiff-backup(1.3.3) and the exact same rsync. I used to use rdiff-backup quite a bit back in debian, but I've moved over to a ...
20
votes
7answers
2k views
Options to efficiently synchronize 1 million files with remote servers?
At a company I work for we have such a thing called "playlists" which are small files ~100-300 bytes each. There's about a million of them. About 100,000 of them get changed every hour. These ...
0
votes
1answer
112 views
Renaming files by date solaris
I’m trying to run the following command
rsync -avz /mnt/backups/`date \
--date=yesterday +\%Y-\%m-\%d`-`date \
--date=yesterday +\%A`/server1/ /mnt/backups/`date \
...
1
vote
2answers
482 views
rsync does not sync files
I have faced with a strange problem. I usually use rsync to sync files between servers and now this utility behaves in a strange way.
Firstly, here is the command I use:
server1# rsync -av -e ssh ...
0
votes
2answers
138 views
Can I stop rsync daemon on port 443 from using ssh?
I have a machine on the LAN with an rsync daemon (on Debian Squeeze) running on default port 873 with this config:
[sync]
path = /mnt/hux/WORK
read only = false
uid = dco
I'm connecting ...
2
votes
3answers
847 views
Converting UTF-8 NFD filenames to UTF-8 NFC, in either rsync or afpd
I have a home file server running FreeNAS 8. A few days ago I used rsync to upload my entire iTunes library from Mac so that I could load my library over the network instead of off a slow USB drive. ...
1
vote
5answers
727 views
How to copy directory from one Linux server to another with a minimum in-between period?
I have a rather big directory on one server (over 4000 files), which I'd like to copy to another server (which contains a previous version of this directory). rsync is the first option, but it will ...
0
votes
2answers
523 views
RSYNC from remote to local excluding folders
How can I download from a remote server to local excluding folders or files?
I have used something like this but the exclude doesn't work...
rsync -avr -P -e ssh --exclude=/path/to/exclude/* ...
0
votes
1answer
128 views
Backing up an rsnapshot directory to a remote device
I have a local backup server that uses rsnapshot with hard links that contains about 10TBs of information which add about 4 to 5GBs per day. It's works great. I've been requested to set up and ...
0
votes
2answers
150 views
File synchronization between the web nodes
I'm looking for some bidirectional data synchronization between the web nodes. I've got two web servers with DNS load balancing. I'm using "lsyncd" at the moment however because of load balancing ...
2
votes
3answers
979 views
Rsync Throttle Upload Bandwidth --bwlimit=KBPS
I am looking to throttle the upload speed of my file transfers during an rsync process.
Does --bwlimit=KBPS mean it sets the internet transfer speed, or the hard drive disk write speed?
...
-1
votes
5answers
262 views
Transer a large number of file between two servers [duplicate]
Possible Duplicate:
Quickest way to transfer 55GB of images to new server
I am migrating from one server to another. I want to transfer the thousands of file from one server to the other.
...
1
vote
2answers
64 views
Rsync Specific Direcotries and files with the same structure
I want to rsync specific directories and files with the same structure
for example :-
source/
source/110/var/lib/mysql
source/110/var/lib/mysql
source/110/var/lib/mysql
source/110/home
...
0
votes
3answers
160 views
Stop rsync from deleting files that are being uploaded
I have a script which will upload files from a specific directory (with rsync) to the server, but in the mean time another script will pull files from the server (also with rsync and with the --delete ...
0
votes
1answer
44 views
Creating a safe environment on (backup) server
I want to use my server as backup server and let other users let their data backup to it aswell. I was thinking of using rsync instead of FTP (due to the obvious reasons), however how would I prevent ...
1
vote
5answers
319 views
Fast Internet Backup
We wish to install some servers in a remote datacentre to act as a backup storage location for our primary datacentre.
Assuming that both sites will have GigE connectivity, what is the best method to ...
7
votes
3answers
592 views
How can I easily confirm in Linux that two separate directories have the exact same contents?
CentOS 5.x
Mq question seemed similar to this one but I wasn't sure...
I have two servers (completely isolated from each other), each with a directory and sub-directories that should have the same ...
0
votes
1answer
116 views
How do I rsync exclude a specific directory
If I have the following directory structure:
foo/
foo.txt
bar/
foo/
hum.txt
how do I exclude the top-level foo directory without excluding bar/foo? When I run:
rsync --exclude-from ...
0
votes
2answers
581 views
rsync Module error
I have a rsync server and i can not list modules or transfer to modules.
Following work correctly:
rsync -v test.txt user@host.com:test
It will be create a new file "test" in the home directory of ...
0
votes
2answers
199 views
ftp using rsync
I use Windows 7 machine and Putty to connect to UNIX servers. I am required to FTP certain files from those server to my local windows machine. For this purpose I use a FTP client like FileZilla or ...
3
votes
1answer
244 views
Rackspace cloud sites to local server backup
I use rackspace cloud sites and don't have accsess to SSH or RSYNC on their servers, but I do access to SSHFS.
I would like to be able to backup my cloud site to my local Ubuntu server, which has ...
1
vote
3answers
156 views
How to mirror server with 150 GB of data
I have a linux server whic is used as web/file/svn/sql server. It is accessed by 100 machines for storing their code files on this server(svn/code/mysql).
The OS is on a 80 GB HDD. The data is on ...
3
votes
1answer
2k views
Optimizing rsync for transferring huge files quickly
This is what I need:
Rsync daemon running on source server. Destination server does a rsync pull as below:
rsync -ptv rsync://source_ip:document/source_path/*.abc destination_path/
Huge binary files ...
2
votes
1answer
551 views
rsync not working - want to copy only certain subdirectories and files
Hi let's say I have a directory like this:
/
my_work
/dir1
keepdir1.ddd
keepdir2.ddd
file.cfg
(lots ...
0
votes
1answer
185 views
file copy error from system to cifs mount
When coping a file greater than 64kB from an Ubuntu server to a CIFS mounted windows share, most of the data is copied, but it seems the last chunk doesn't get copied. The size doesn't match, and the ...
0
votes
2answers
228 views
How to implement data synchronization/multiplication across multiple servers?
We have a website that runs on multiple web servers. Those servers need to be in synchronization - program files and user uploaded data should be present on both servers. For now this is implemented ...
