Rsync is a fast and extraordinarily versatile file copying tool. It can copy locally, to/from another host over any remote shell, or to/from a remote rsync daemon. It offers a large number of options that control every aspect of its behavior and permit very flexible specification of the set of files ...
-1
votes
5answers
66 views
Transer a large number of file between two servers [closed]
Possible Duplicate:
Quickest way to transfer 55GB of images to new server
I am migrating from one server to another. I want to transfer the thousands of file from one server to the other.
...
1
vote
2answers
32 views
Rsync Specific Direcotries and files with the same structure
I want to rsync specific directories and files with the same structure
for example :-
source/
source/110/var/lib/mysql
source/110/var/lib/mysql
source/110/var/lib/mysql
source/110/home
...
-2
votes
0answers
23 views
Cloud Backup provider that uses rsync [closed]
I'm looking for a cloud backup provider that uses rsync. I have used rsync.net for many years but their pricing model isn't keeping up with the rest of the market and I'm looking at several tens of ...
0
votes
3answers
44 views
Stop rsync from deleting files that are being uploaded
I have a script which will upload files from a specific directory (with rsync) to the server, but in the mean time another script will pull files from the server (also with rsync and with the --delete ...
0
votes
1answer
29 views
Creating a safe environment on (backup) server
I want to use my server as backup server and let other users let their data backup to it aswell. I was thinking of using rsync instead of FTP (due to the obvious reasons), however how would I prevent ...
1
vote
5answers
116 views
Fast Internet Backup
We wish to install some servers in a remote datacentre to act as a backup storage location for our primary datacentre.
Assuming that both sites will have GigE connectivity, what is the best method to ...
4
votes
2answers
98 views
How can I easily confirm in CentOS that two separate directories have the exact same contents?
CentOS 5.x
I apologize in advance if this is a duplicate question. It seemed similar to this one but I wasn't sure.
I have two servers, each with a directory and sub-directories that should have ...
0
votes
1answer
14 views
How do I rsync exclude a specific directory
If I have the following directory structure:
foo/
foo.txt
bar/
foo/
hum.txt
how do I exclude the top-level foo directory without excluding bar/foo? When I run:
rsync --exclude-from ...
0
votes
2answers
60 views
rsync Module error
I have a rsync server and i can not list modules or transfer to modules.
Following work correctly:
rsync -v test.txt user@host.com:test
It will be create a new file "test" in the home directory of ...
0
votes
2answers
45 views
ftp using rsync
I use Windows 7 machine and Putty to connect to UNIX servers. I am required to FTP certain files from those server to my local windows machine. For this purpose I use a FTP client like FileZilla or ...
2
votes
0answers
54 views
Rackspace cloud sites to local server backup
I use rackspace cloud sites and don't have accsess to SSH or RSYNC on their servers, but I do access to SSHFS.
I would like to be able to backup my cloud site to my local Ubuntu server, which has ...
1
vote
3answers
78 views
How to mirror server with 150 GB of data
I have a linux server whic is used as web/file/svn/sql server. It is accessed by 100 machines for storing their code files on this server(svn/code/mysql).
The OS is on a 80 GB HDD. The data is on ...
3
votes
1answer
66 views
Optimizing rsync for transferring huge files quickly
This is what I need:
Rsync daemon running on source server. Destination server does a rsync pull as below:
rsync -ptv rsync://source_ip:document/source_path/*.abc destination_path/
Huge binary files ...
0
votes
1answer
42 views
rsync not working - want to copy only certain subdirectories and files
Hi let's say I have a directory like this:
/
my_work
/dir1
keepdir1.ddd
keepdir2.ddd
file.cfg
(lots ...
0
votes
0answers
48 views
file copy error from system to cifs mount
When coping a file greater than 64kB from an Ubuntu server to a CIFS mounted windows share, most of the data is copied, but it seems the last chunk doesn't get copied. The size doesn't match, and the ...
0
votes
2answers
57 views
How to implement data synchronization/multiplication across multiple servers?
We have a website that runs on multiple web servers. Those servers need to be in synchronization - program files and user uploaded data should be present on both servers. For now this is implemented ...
2
votes
7answers
315 views
Copying huge files between two remote machines - Efficiently
I have a shell script which keeps on copying huge files (2 GB to 5 GB) between remote systems.
Key based authentication is used with agent-forwarding and everything works.
For ex: Say the shell script ...
2
votes
4answers
106 views
Optimizing RAID 5 for BackupPC use (small random reads)
I am running a BackupPC server with a hardware RAID 5 for the main storage of the backups. Since the machine was created on a tiny budget, the controller is a 3Ware 9500S-4LP for the PCI port and the ...
1
vote
1answer
46 views
Synchronize files over FTP where files from the FTP always wins in case of conflict
Setup:
One file server with folders for each project.
One employee working from home that needs the files to be on a local NAS since the connection isn't good enough to work via VPN. So, a few project ...
2
votes
2answers
73 views
Deleting folders with rsync “move”?
rsync can be coaxed into moving folders very similarly and superiorly to traditional mv with the following options:
rsync -axvvES --remove-source-files source_directory /destination/
However one ...
-1
votes
1answer
23 views
use rsync in contribute mode for syncing files
What's the rsync options that will set it up in a contribute mode, i.e.: files from source can only update the destination, not overwrite or deletion. Say, I have a picture folder in my source which ...
1
vote
2answers
65 views
Backup to NFS with different user IDs
I'm running Xubuntu and trying to back up my filesystem to an NFS share using rsync using the command:
rsync -vSHPhhaX --numeric-ids --delete --exclude-from=/home/rena/.scripts/exclude-list / ...
0
votes
2answers
41 views
Start and stop rsync at determined hours
I want to run rsync over an adsl connection, only when i'm not using it (from midnight to the 6am).
The download of the files has to stop on 6am, and resume on midnight. There are both huge files ...
1
vote
1answer
51 views
Combining multiple Rsync synchronizations
I'm trying to combine multiple rsync commands into one command. Currently I use the following command:
/usr/bin/rsync --exclude-from=/directory/exclude.txt --delete --rsync-path "/usr/bin/sudo ...
1
vote
2answers
59 views
rsync ionice destination
To avoid rsync to starve the system and network we use ionice when starting rsync and set the --bwlimit parameter. For example:
ionice -c2 -n7 rsync -aH --bwlimit=30000 /foo root@dest.com:/
This ...
-3
votes
2answers
79 views
How to rsync a list of files from current directory to the home directory of a remote user? [closed]
I want to deploy a list of file from inside a file let's say files.lst:
+ .profile
+ .hg/hgrc
+ .mc/*
- /*
rsync -vvltr . --include-from 'files.lst' . destdir
Desired behaviour:
copy recusively ...
1
vote
1answer
29 views
How to specify a path relative to user home directory for destination when using rsync over ssh
I am using rsync over ssh and trying without success to sync files to a place inside user home directory.
All the time rsync seams to want to use full paths.
Tried things like:
rsync --rsh=ssh ...
1
vote
1answer
82 views
Rsync inconsistency between CLI and crontab
I want to use rsync to synchronise my home folder with a "backup" copy on another drive on an Ubuntu 11.10 machine. And I want it to happen every 15 minutes.
If I manually run:
rsync -ar --delete ...
2
votes
2answers
78 views
Forcing rsync to convert file names to lower case
We are using rsync to transfer some (millions) files from a Windows (NTFS/CYGWIN) server to a Linux (RHEL) server. We would like to force all file and directory names on the Linux box to be lower ...
2
votes
3answers
73 views
SSH tunnel & Rsync thru two proxy/firewalls
Screnario:
[internal_server_1]AA------AB[firewall_1]AC----+
10.2.0.3-^ ^-10.2.0.2 |
internet
10.3.0.3-v ...
4
votes
4answers
104 views
Do you need -e ssh for rsync?
I always used to use the following command when copying from a server:
rsync --progress -avze ssh user@host:/path/to/files ./here. However, a friend of mind showed me that I can simply do rsync ...
5
votes
1answer
92 views
does rsync's delta algorithm work on a samba share?
I have a cron job to use rsync to sync the data on a windows samba share (that i mount using /etc/fstab on boot). My problem is that the transfer seems to take almost as long as the initial transfer ...
4
votes
2answers
325 views
Why is my rsync so slow?
My Laptop and my workstation are both connected to a Gigabit Switch. Both are running Linux. But when I copy files with rsync, it performs badly.
I get about 22 MB/s. Shouldn't I theoretically get ...
0
votes
2answers
22 views
Is it useful to maintain file and folder permission in a Backup copy, using rSync?
i'm using rsync to make a backup copy of an HFS+ partition (mac filesystem).
I'm wondering if is it useful to maintain file and folder permission when i do a backup copy.
Thanks
1
vote
2answers
186 views
Speed up rsync by running multiple instances at once?
I have to transfer a big directory to another server.
My problem is that i cannot use the full bandwidth that would be available, because one concurrent tcp stream does not get as fast.
Basically ...
0
votes
0answers
42 views
Are a lot of files making rsnapshot impossible?
I'm considering using rsnapshot for our backups, but I read in the RIBS documentation (https://github.com/jrust/ribs) that hardlinks with a lot of files, they mention >1000, which doesn't strike me a ...
0
votes
0answers
51 views
Transport endpoint is not connected: what cause it?
I mount on my Ubuntu server, a remote HFS+ partition (of a osX client) using afpfs, then i launch an rsync , and after some gb transfered i get that error and rsync stop to works.
What's the problem ...
3
votes
1answer
103 views
Rsync: General file/folder synchronization
I have a file server, which is in-charge of pulling a folder tree from multiple workstations on a daily basis. My current method for this is by using rsync, (which works pretty well provided directory ...
-1
votes
1answer
51 views
Can I access rsync in this situation?
My CISC professor has had our class use SSH to log in to his server, hosted by a company called Panix. We use vim to edit and compile our code on his server.
We just took an exam, and as part of said ...
0
votes
1answer
49 views
rsync destination based on file date
I have a large directory of log files on a server. All the logs are in one big directory.
We would like to back these up to another host (our archive server), and only keep the last 90 days of ...
1
vote
1answer
49 views
rsync : Read input from a file and sync accordingly
I have a text file which contains the list of files and directories that I want to copy (one on a line). Now I want rsync to take this input from my text file and sync it to the destination that I ...
2
votes
1answer
112 views
RSync over SSH hangs and fails with timeout
Client: Gentoo, GCC 4.3.4, RSync 3.0.9
Server: Ubuntu 10.04.4 LTS, RSync 3.0.7
Client and server connectet through is Internet, about 2Mbps. Ping is ok.
RSync called on any files in any direction ...
0
votes
2answers
364 views
Do Robocopy copy efficiently large files?
in our small sized company we use Vmware. We backup the VM with Veeam.
Resulting files are in order of 200-300 gigabyte per VM, for a total of 1/1.2 terabyte of data.
I use robocopy to copy VM files ...
0
votes
0answers
34 views
how to log rsync or scp connections to my server?
I have a Ubuntu server for distributing big datasets to some users. I would like to have a log with user-time_stamp-time-rsync_comand (like the appache log). Or at least a log of user-timestamp when ...
1
vote
2answers
74 views
rsync incremental history
I'm trying to create a backup of a LVM volume and I have a simple img file which contains all data. Is there any way to have this have incrementally backed up using rsync? Like a full backup every ...
0
votes
1answer
82 views
rsync files created or modified from windows share on cifs mount
I want to rsync the files to my local linux box, but I only want files that have been created or modified within the past 30 days.
I'm mounting a windows share from linux using this command:
mount ...
0
votes
1answer
46 views
Lsyncd installing issue on 64bit
During the installation of Lsyncd 2.0.6 ./configure && make && make install process I am receiving a not found error.
gcc: /usr/lib/liblua.a: No such file or directory
make[1]: *** ...
1
vote
0answers
173 views
DeltaCopy (Rsync for windows) giving an error on task run
I was suggested DeltaCopy to set up a nightly backup between two Windows 2008 R2 servers.
After setting up the server side (Amazon EC2 instance where files will be backed to) and setting up the ...
0
votes
8answers
403 views
Rsync for Windows with support for ACLs
I have a need for a free rsync-like tool for Windows (very preferably with some sort of delta encoding) that supports synchronizing Windows ACLs and can copy open files, probably via VSS/Shadow ...
0
votes
4answers
127 views
Linux du and rsync 100% disk utilization
Whenever I run du -sh or rsync I get my disk utilisation at 100%. This causes mysql slow queries to appear, which usually causes my site going down.
Any tips or tricks running these to commands ...