Tagged Questions

0
votes
1answer
43 views

Rsync a directory from a local server to a remote server without losing permissions

I need to transfer a directory from my local server to a remote server on the exact same place on the remote server. In the directory, there are a lot of different users involved and I want to ...
1
vote
1answer
62 views

Is there a global config file for Unison synchronization tool?

I'd like all my unison profiles to have merge = Name * -> meld CURRENT1 CURRENT2 diff = /usr/bin/meld CURRENT1 CURRENT2 confirmmerge = true as options. I know I can add these options to each ...
5
votes
2answers
203 views

Rsync show progress for individual file

I'm using rsync to upload/download a pretty large file (20Gb). I'm aware of --progress option, but what it does in my case is just showing me the result at the end. My problem is that during some ...
1
vote
2answers
131 views

rsync to EC2: Identity file not accessible

I'm trying to rsync a file over to my EC2 instance: rsync -Paz --rsh "ssh -i ~/.ssh/myfile.pem" --rsync-path "sudo rsync" file.pdf ubuntu@ec2-XXX-XX-XX-X.compute-1.amazonaws.com:/home/ubuntu/ ...
1
vote
5answers
319 views

Fast Internet Backup

We wish to install some servers in a remote datacentre to act as a backup storage location for our primary datacentre. Assuming that both sites will have GigE connectivity, what is the best method to ...
3
votes
2answers
2k views

Speed up rsync by running multiple instances at once?

I have to transfer a big directory to another server. My problem is that i cannot use the full bandwidth that would be available, because one concurrent tcp stream does not get as fast. Basically ...
5
votes
6answers
1k views

what is the fastest and most reliable way of transferring a lot of files?

I'm trying to transfer about 100k files totaling 90gb. Right now I'm using rsync daemon but its slow 3.4mb/s and I need to do this a number of times. I'm wondering what options do I have that would ...
2
votes
1answer
364 views

Checksumming to verify rsync transfers

So rsync runs some checksums in the course of deciding what to transfer (i.e. what blocks within a file). But is there any reason to trust the file you end up with on the receive side any more than ...
-2
votes
2answers
235 views

Need to transfer ~3TB of data to a remote server [duplicate]

Possible Duplicate: Copy large file from one Linux server to another I need to transfer about ~3tb of data to another server. I am currently using rsync -z but it is going at 250kb/s so it ...
3
votes
6answers
520 views

Transfer a file from remote server A to remote server B from server C

I have an interesting problem I'm trying to solve. I have a JumpBox server that I have in order to securely ssh into client's servers. This is the only server my clients ever open up port 22 to. ...
2
votes
1answer
374 views

rsync to import/export delta-transfer or incremental copy result

My scenario is to distribute several GB files from a staging server to tens of identical destination servers. Since rsync can do delta-transfer or incremental copy, I was wondering when rsync file to ...
1
vote
1answer
220 views

cwRsync performance on Win Server 2003

I've tested several cases for cwRsync (3.0) on Win Server 2003. My scenario is have a rsync daemon on a source host with source files ~3GB total. And there're 50 dest servers running rsync command to ...
1
vote
2answers
894 views

Can't access a user profile as administrator?

I am trying to copy the complete user profile of an old XP pc to a new computer. I want to copy the entire profile as I have to get rid of the older PC quite soon, and would sort through the files at ...
4
votes
3answers
2k views

Chunking large rsync transfers?

We use rsync to update a mirror of our primary file server to an off-site colocated backup server. One of the issues we currently have is that our file server has > 1TB of mostly smaller files (in ...
7
votes
3answers
791 views

linux to linux, 10TB transfer?

I've looked at all the previous similar questions, but the answers seemed to be all over the place and no one was moving a lot of data (100GB != 10TB). I've got about 10TB that I need to move from ...
1
vote
1answer
243 views

Rsync and Lazy mode?

Since transferring or copying a file that is being used sometimes causes corruption of the transferred file, can we define a time interval in which Rsync checks each file in a given directory to see ...
11
votes
3answers
14k views

Getting rsync to move file from source to destination?

Is rsync is a good choice for my project ? I have to : - copy files from source to destination folder via SSH, - be sure all files are copied, - delete source files after copy. - if I have conflict ...
6
votes
1answer
4k views

rsync - Exclude files that are over a certain size?

I am doing a backup of my desktop to a remote machine. I'm basically doing rsync -a ~ example.com:backup/ However there are loads of large files, e.g. wikipedia dumps etc. Most of the files I care a ...
6
votes
6answers
1k views

Remote file copy util (like rsync) but that will take account of data already copied (in this session)?

Let's say I have a directory with 2 files, both are identical and quite large (e.g. 2GB ea.) I want to rsync that directory to a remote host. As I understand it (and I could be wrong), rsync ...
2
votes
1answer
2k views

Exclude a set of file types when running rsync

I'm running the following rsync command rsync --times -v --recursive --compress --exclude "*.svn" --rsh=/usr/bin/ssh source/folder/ user@ip:httpdocs/ which excludes *.svn files when running. My ...
1
vote
2answers
610 views

Sync a folder on a remote UNIX server from Windows with rsync

I am trying to sync the contents of a directory on my Windos machine with a UNIX server. I have spent a long while reading the rsync documentation and have come up with the following command: rsync ...
3
votes
3answers
1k views

Ignore windows hidden files when copying with rsync

I need to keep in sync a very large directory structure (a few hundreds GB) between a Windows machine and a Linux machine. I'm using rsync to do the copy because it automatically ignores unchanged ...
3
votes
10answers
3k views

Using rsync to quickly upload a file that is similar to another file

I'm putting together a deployment script which tars up a directory of my code, names the tar file after the current date and time, pushes that up to the server, untars it in a directory of the same ...
34
votes
15answers
6k views

Favorite rsync tips and tricks

The more I use rsync the more I realise that it's a swiss army knife of file transfer. There are so many options. I recently found out that you can go --remove-source-files and it'll delete a file ...
7
votes
1answer
3k views

Getting rsync to delete files from the *sender* after transfer

I'm using rsync to move one directory to another. Is there some way to get rsync to incrementally delete a file from the sender after it has copied it to the reciever?
51
votes
15answers
40k views

Copying a large directory tree locally? cp or rsync?

I have to copy a large directory tree, about 1.8 TB. It's all local. Out of habit I'd use rsync, however I wonder if there's much point, and if I should rather use cp. I'm worried about permissions ...
12
votes
9answers
7k views

Windows rsync that supports long file names, or an good alternative?

I currently rsync on a Linux host to copy things from Windows to my Linux box. But I can't copy files with long names. I have tried DeltaCopy, cwrsync, and cygwin. From what I have found there all ...