0
votes
3answers
583 views

Sync directory across two servers using rsync (or alternative for syncing directories)

I have two VMs that should have identical files in this directory: /var/www/owncloud/data/admin/files/ I initially thought that I could use rsync with cron to copy the files every two minutes: On ...
1
vote
1answer
79 views

Some files are not transferred by using rsync between 2 servers

I used rsync with -av parameter to migrate a website from one server to another. there was no error displayed but the size of the folders are not the same and the website does not work correctly. so ...
2
votes
2answers
185 views

Copy entire filesystem in a folder where a raid-1 array is mounted

I am trying to migrate from a single disk drive system to a double disk drive software raid-1 system that already has a running system on it. Meaning that formatting and having a new installation of ...
0
votes
2answers
1k views

RSYNC from remote to local excluding folders

How can I download from a remote server to local excluding folders or files? I have used something like this but the exclude doesn't work... rsync -avr -P -e ssh --exclude=/path/to/exclude/* ...
2
votes
1answer
984 views

rsync not working - want to copy only certain subdirectories and files

Hi let's say I have a directory like this: / my_work /dir1 keepdir1.ddd keepdir2.ddd file.cfg (lots ...
3
votes
7answers
6k views

Copying huge files between two remote machines - Efficiently

I have a shell script which keeps on copying huge files (2 GB to 5 GB) between remote systems. Key based authentication is used with agent-forwarding and everything works. For ex: Say the shell script ...
2
votes
2answers
413 views

Copy whole files only

Is there any way to copy directory from one filesystem to another but remove the partial file in case we run out of disk space on target filesystem? I searched cp and rsync manuals but did not find ...
7
votes
5answers
5k views

Rsync : copying over timestamps only

Currently I have two directories A/ and B/ which are identical in every respect, with the exception of the timestamps. Therefore if I run the command : rsync --dry-run -crvv A/ B/ then all files ...
0
votes
1answer
126 views

How to use rsync to copy images and dir

I am in the middle of merging 2 directories into 1. /competitions/1 /competitions/2 /competitions/3 /gallery/1 /gallery/2 /gallery/3 I want to copy all the files in /competitions to /gallery and ...
2
votes
4answers
1k views

fastest way to mirror a directory containing millions of small files

I need to copy a 700G ISCSI mounted folder to a folder on the local hard drive, while maintaining the existing permissions and ownership. The data in the folder consists of about a million mostly ...
6
votes
4answers
3k views

How can I reduce resource usage when copying a large file?

I need to move a large file (corrupt MySQL table ~40GB) onto a seperate server in order to repair it. (When trying to repair on my production server, it quickly killed the server). In order to do ...
3
votes
5answers
2k views

How do I copy a directory tree but not the files in Linux?

I want to copy about 200 directories & subdirectories from one location to another but I don't want to copy the thousands of files within those directories. I am on Linux. Note: I don't have ...
1
vote
3answers
733 views

RCP (Remote Copy Protocol) in Ubuntu

On our Cisco-Routers we enabled RCP. Now we want copy all the running-config with our Ubuntu Server but I can't find any suitable command. I tried copying with rsync and cp but that did not work. ...
0
votes
2answers
484 views

SMB extremely slow when rsync from NAS? [duplicate]

Possible Duplicate: Speeding up rsync over smb I started to rsync a mount smb share to a local raid partition yesterday evening. After 12 hours it has copied like 30% of 400 GB... the ...
5
votes
3answers
4k views

rsync and include / exclude. How hard can it be?

I'm trying to recursively copy a directory / file structure from one directory to another, keeping only html files. Should be a simple case of include / exclude shouldn't it? I just want to print out ...
7
votes
3answers
944 views

linux to linux, 10TB transfer?

I've looked at all the previous similar questions, but the answers seemed to be all over the place and no one was moving a lot of data (100GB != 10TB). I've got about 10TB that I need to move from ...
0
votes
2answers
211 views

Syncing 1TB+ to a iSCSI device, software needed

I need to sync a local disk to a iSCSI mount on Windows (server 2003), and I'm struggling to find software that's capable of doing so in a reasonable timeframe. Notes on the current 1TB disk: - 800GB ...
6
votes
4answers
1k views

How to copy a 200GB file faster?

I got a 200GB .tgz file on server A(RHEL 5.2). I wanna transfer that file to server B (RHEL 5.3). Server B is on ESXi 4 Update1. I gave 10GB to that Server B VM, with 4 vCPUs. Both Server A and ...
0
votes
1answer
628 views

rsync's list of files to transfer keeps going up

I'm copying some files locally from one directory to another using rsync, the options I'm using are -aPhW. The -P gives me a progress bar, and tells me how many transfers are left, such as ...
13
votes
6answers
7k views

Unix copy command that has a progress bar, but not as heavy as rsync

I need to copy lots of files. Usually I use rsync because I pass it the -aP options and I can see (a) how many files are left to process and (b) how much of each individual file is copied. However ...
7
votes
3answers
8k views

How to perform a secure rsync between servers across an unsecured network

Basically what I'm asking is, has anyone come across a means by which to wrap rsync inside ssh. With OpenSSH v4.9+ sftp has some nice options that allow you to chroot the incoming connection and such ...