3
votes
2answers
45 views

BackupPC Taking over 72 hours to backup 250GB's

I am using BackupPC to backup some workstations at the office. One workstations in particular has a sizable amount of data when compared to the rest, however, it's not that large in general (talking ...
0
votes
0answers
116 views

Backup archive format for delta syncing to Dropbox?

On an Amazon EC2 server with Linux AMI, I currently have a daily backup cron job be run: TMP_BACKUP_FILE="/tmp/backup.tar" BACKUP_FILE="/home/ec2-user/Dropbox/Backup/backup.tar" rm -f ...
3
votes
1answer
140 views

FreeBSD restore of /rescue

I'm running a restore from a previous backup of my FreeBSD system, and run into trouble when restoring / (excluding mount-points). The problem is that /rescue fills the / partition (to the extent that ...
0
votes
2answers
99 views

moving files and directories between two machine, via a third, preserving permissions and usernames

The situation is as follows: Machine A has a file repository accessible via rsync Machine B needs the above mentioned files with all permissions and ownerships intact (including groups etc) ...
0
votes
1answer
264 views

resumable tar over ssh

I'd like to use tar cf - | ssh user@hostname tar xf - to copy a very large set of files. The only problem is that it will be over a very flakey VPN link. Is it possible to somehow set up a resumable ...
0
votes
1answer
285 views

Backing up file moves with rsync + tar

I have a mirroring system in place with rsync and it works well. However, moving a file causes it to be transferred again in its entirety. Given what I know about the rsync algorithm's rolling ...
-1
votes
5answers
366 views

Transer a large number of file between two servers [duplicate]

Possible Duplicate: Quickest way to transfer 55GB of images to new server I am migrating from one server to another. I want to transfer the thousands of file from one server to the other. ...
1
vote
1answer
241 views

Make rsync working with compressed target or tar creating no increment files

I need to make a backup on my external hard drive. I looked both at rsync and incremental tar. The problem is that I want my backup to be compressed. With rsync I can only compress the data transfer, ...
7
votes
9answers
1k views

Copy 10 million images in a single folder to another server

Now I know you shouldn't ever put 10 million files into a single directory to begin with. Blame it on the developers, but as it stands that’s where I am at. We will be fixing it and moving them into ...
2
votes
3answers
1k views

Concurrent modification during backup: rsync vs dump vs tar vs?

I have a Linux log server where multiple applications write data. Data is written in bursts, and in a lot of different files. I need to make a backup of this mess, preferably preserving as much ...
2
votes
7answers
1k views

Backup - rsync or tar

We're looking to backup about 100gb+ of data containing small files (10kb+) each. The backup needs to be done as fast as possible to another harddrive weekly. Which is the better (especially speed ...
0
votes
3answers
945 views

ssh & tar to incrementally transfer (like rsync)

In a hosting environment that has no rsync client, I'd like to perform an action similar to what rsync does: send only those files that have changed. I would perform this one-liner on the current ...
5
votes
7answers
1k views

fastest backup for large files

what is the fastest way to duplicate a folder contain few files with few hundred megs size and other few megs small files? (say, /var/lib/mysql) cp or tar or rsync or...??
7
votes
3answers
7k views

How to perform a secure rsync between servers across an unsecured network

Basically what I'm asking is, has anyone come across a means by which to wrap rsync inside ssh. With OpenSSH v4.9+ sftp has some nice options that allow you to chroot the incoming connection and such ...