0
votes
1answer
22 views

s3cmd: on-the-fly backup

To do backups I created a script that makes an archive of all the folders I need to backup, sends it to S3 (through s3cmd) and then deletes it after upload has been completed. I'm looking for a way ...
3
votes
2answers
46 views

BackupPC Taking over 72 hours to backup 250GB's

I am using BackupPC to backup some workstations at the office. One workstations in particular has a sizable amount of data when compared to the rest, however, it's not that large in general (talking ...
4
votes
1answer
258 views

Should I exclude all 'dev/' or only 'dev/pts/' during full server tar backup?

I'm curious why in all backup tutorials I found tar command excludes among others /dev/pts and not all of /dev/ Why would I want to backup anything under dev?
2
votes
2answers
26 views

Shell command to filter out non-existing files in a pipe

I'm looking for a nice way to generate a backup tar.gz of what is going to be overridden by the extraction of another tar.gz. tar -ztf patch.tar.gz | grep -v "/$" | tar -T- -zcvf backup.tar.gz This ...
1
vote
4answers
83 views

How to restore a backup from a tgz file in linux

How can i restore from a backup.tgz file generated from another linux server on my own server? I tried the command the following command: tar xvpfz backup.tgz -C / The above command worked, but it ...
0
votes
1answer
87 views

dd unable to write to tape drive

I'm trying to dump our online backups to tape; for obvious reasons I want to encrypt the data on the tapes, so to write to the tape I need to tar everything up, pipe that to openssl to encrypt it, ...
0
votes
1answer
42 views

Faster picking of files from a tar archive

We've got a collection of servers that we're backing up using Duplicity. We're trying to build some functionality for our staff so that they can select a file and view the available versions for ...
0
votes
0answers
71 views

Tar backup to webdav server: how to split the output file using stdin?

I need some advice on storing a tar file to a webdav server. I'd like to make automated backups of my VPS, however the available space is limited so I can't store the backup before uploading it to the ...
1
vote
1answer
41 views

How can I backup large amount of small files?

A Windows filesystem is mounted through samba and I am trying to compress a large amount of small files: find /path/to/files/ -newermt "2012-01-01 00:00:00" -path '*/*log.txt' -exec tar cvfz ...
0
votes
2answers
59 views

Why does system lag or stall after successful completion of tar backup command?

I have a script that runs backup of system files via tar as a cronjob for my server. Every time the script is being fired off, it completed the task as successful. All backups were tested and appeared ...
0
votes
0answers
116 views

Backup archive format for delta syncing to Dropbox?

On an Amazon EC2 server with Linux AMI, I currently have a daily backup cron job be run: TMP_BACKUP_FILE="/tmp/backup.tar" BACKUP_FILE="/home/ec2-user/Dropbox/Backup/backup.tar" rm -f ...
2
votes
1answer
74 views

Exclude mounted folders from tar archive

we want to backup our server and this seems to be pretty simple thing to do except one. Currently we use something like this: tar cvpjf backup.tar.bz2 --exclude=/proc --exclude=/lost+found ...
1
vote
2answers
46 views

How to maintain up-to-date snapshot tar archive efficiently?

I have a large directory of files and I would like to maintain a single compressed tar archive that I can server over http containing all the files which is brought up to date once each day. Many of ...
2
votes
3answers
123 views

tar incremental backup is backing everything up, every time when used on the Dropbox directory

I made an incremental backup about 10 months ago (on Jan 27, 2013), creating a .snar metadata file. Now, when I try to make an incremental backup using tar --create --file=dropbox_incremental_1.tar ...
0
votes
1answer
196 views

How do I backup 50GB+ of files on a linux box to a remote sftp account [closed]

How do I backup 50GB+ of files on a linux box to a remote sftp account. My requirements Store several versions of the backups. Encrypted before sent to remote server. Disk and bandwidth efficent, ...
2
votes
2answers
61 views

Segmenting mysql backups using tar

In addition to using mysqldump, I've been backing up my mysql server by tarring up /var/lib/mysql for redundancy and convenience. This directory includes ibdata, ib_logfile0, and ib_logfile1 as well ...
3
votes
1answer
163 views

Can I get tar to not use the filesystem cache when reading files?

We have a cronned job on a production web server that requires tarring up files from across the filesystem. It runs for about 105 minutes, and during that time, Apache starts swapping because all ...
2
votes
3answers
3k views

Linux backup using tar

Im new to linux backup. Im thinking of full system backup of my linux server using tar. I came up with the following code: tar -zcvpf /archive/fullbackup.tar.gz --exclude=/archive --exclude=/mnt ...
1
vote
3answers
157 views

Strategy for backing up a very large website (~40GB)

I have a website which works with lots and lots of text files - now they take up about 40 GB of data and increasing over time. I need to make a full daily backup. My current strategy is to make a ...
3
votes
1answer
140 views

FreeBSD restore of /rescue

I'm running a restore from a previous backup of my FreeBSD system, and run into trouble when restoring / (excluding mount-points). The problem is that /rescue fills the / partition (to the extent that ...
0
votes
1answer
285 views

Backing up file moves with rsync + tar

I have a mirroring system in place with rsync and it works well. However, moving a file causes it to be transferred again in its entirety. Given what I know about the rsync algorithm's rolling ...
1
vote
2answers
149 views

Run command to untar file in timestamped folder?

I have a .tar file that is transferred to our server every night by one of our client management systems. The file is a compressed .sql file which I need to uncompress and dump into our database. The ...
0
votes
1answer
185 views

How to unpack specific directory from /home backup packed with pigz+tar+gzip

Normally I'm extracting my copies with: pigz -dc backup2_week1_system.tar.gz | tar xzvf - Now I want to unpack specific directory from /home/user for example admin
2
votes
3answers
824 views

tar gzip slowing down server

I have a backup script that: compress some files generate md5 copy the compressed file to another server. the other server finishes comparing MD5 (to find copy errors). Here it's the core script: ...
4
votes
4answers
341 views

Ultrium 3 tape drive shoe-shining, 3Mb/s: and it's not the cable

I have a HP 960 Ultrium 3 tape drive. Since I got it, (second hand, £90) I've been experiencing shoe-shining. Writing with tar in Linux, I average about 3Mb/s write speed. I've tried replacing both ...
2
votes
1answer
418 views

sudoers not working for tar command

I want to disable the requirement of sudo or running as root for a bash script that does backups with tar. I added this line to my sudoers file username ALL=NOPASSWD: /bin/tar However after I ...
1
vote
1answer
241 views

Make rsync working with compressed target or tar creating no increment files

I need to make a backup on my external hard drive. I looked both at rsync and incremental tar. The problem is that I want my backup to be compressed. With rsync I can only compress the data transfer, ...
2
votes
1answer
80 views

Linux - Splitting a backup into two steps

I create a tarball using tar zcf arhive.tar.gz dir/ and this works ok. Now I wanted to split this into two simple archives, one only for images, the other -- for everything else. It seems that ...
0
votes
2answers
461 views

How can I make monthly backups (with dated file names) using Cron on Debian?

I'm having trouble adding the date to the backup file's filename. Here's the Cron command (for testing): */2 * * * tar -zcf /var/backups/www-(back tick)date +%Y%m%d(back tick).tgz /var/www/ It should ...
2
votes
1answer
163 views

How to remove a certain folder when tar zipping?

I want to remove a folder when I'm creating a tar.gz file as it's for a backup and it takes too much space and is not required I am using the following command; tar -cvzf ...
2
votes
4answers
1k views

Linux - Bare Metal Restore from a Tar file

I make a backup of my Debian webserver on a daily basis. A full backup on Sunday, and differentials each other day of the week. The backup is made with Tar. I backup the whole system into the Tar ...
3
votes
1answer
466 views

Does tarring up small files into one big tar file before writing them to tape increase the level of data loss when an error occurs?

I've been looking at our backups recently and noticed that the tape throughput is a lot lower when writing lots of small files, so was thinking of tarring those small files up into one big tar file ...
2
votes
3answers
247 views

Bandwidth-friendly backup strategy using tar?

We've used tar to backup and compress (gzip) selected directories on our file server with very good results until recently. Each and every one of our backups are stored on mirrored (RAID) harddrives ...
0
votes
2answers
58 views

Update and synchronize servers

I have two servers.. One has websites running and other have backup of those websites.. I need to synchronize the servers every week such that the files that were updated or changed after the previous ...
1
vote
2answers
583 views

Quick and Easy Backup of Remote Server?

I'm switching from a slower remote server to a faster one. (In a nutshell.) Everything seems to have been migrated properly, but just incase some things didn't get transferred properly, I'd like to ...
1
vote
2answers
3k views

Check integrity of .tar.gz backup

If you backup your system and create a .tar.gz with thousands of files and directories, how do you easily check its integrity? (ie without having to decompress). It's good to keep backups, but it's ...
3
votes
2answers
714 views

tar incremental backup with --listed-incremental does not work for me (Linux, Ubuntu)

according to http://www.gnu.org/software/automake/manual/tar/Incremental-Dumps.html, i try to create incremental backups with tar and --listed-incremental on my Ubuntu, but the --listed-incremental ...
0
votes
2answers
306 views

tar too slow when file doesn't exist!

I have a gigantic list of files on a text files. This list is passed to tar, like this: cat list.txt | xargs tar rvf archive.tar --ignore-failed-read The problem is that some files that are on the ...
0
votes
1answer
410 views

Python script take long time to backup folder

I copied this script from some book to make tar.bz2 of some folders for backup. #!/usr/bin/env python import tarfile, os def make_tar(folder_to_backup, dest_folder, compression='bz2'): if ...
0
votes
2answers
808 views

Differential backup with TAR relative to specific weekday

I want to have the following backup cycle on Debian Lenny: Monday : Full backup Tuesday : Differential backup relative to Monday Wednesday: Differential backup relative to Monday Thursday : ...
2
votes
3answers
303 views

Which tar file format should I use?

tar can create the archive in different formats. GNU tar, ustar, pax, v7. What would be the best for long time archiving? Is there significant differencies in these formats? I would use the best ...
4
votes
4answers
3k views

How to manually extract a backup set made by duplicity?

I have a set of files on my webserver produced by duplicity software: duplicity-full.20110315T085334Z.vol1.difftar.gz duplicity-full.20110315T085334Z.vol2.difftar.gz ...
0
votes
1answer
117 views

Problem restoring from tar backup: why are there /dev/disk/by-id/ symlinks and how can I avoid them?

I'm trying to make a bare-bone backup system with the most basic tools available on openSUSE 11.3 (in this case: bash, fdisk, tar & grub legacy) Here's the workflow for my scripts: backup.sh: ...
5
votes
2answers
292 views

tar file modified bit (am I being BS'd to?)

I'm working on a project where I'll be using tar to incrementally backup data on a server to a number of tapes. According to a senior co-worker of mine, tar will "set special flags on files so that ...
0
votes
1answer
303 views

Tar: avoid archiving of files larger than certain size

I want to archive files (with tar) which are below 3 MB in size. But I also want to retain the directories in which those files exist. (so I cannot use find command). I just want to avoid the files ...
0
votes
12answers
962 views

How do you backup your site? [closed]

How do you backup your site? I am especially interested when you have a large site (20GB+) with thousands of files? Is there anything clever than the usual tar -zcvf backup2010.tar.gz ./public_html/ ...
0
votes
2answers
749 views

Mail backup error (tar Cannot stat: No such file or directory)

I have got this error in during my mail server backup: 2010-09-16 06:24:20 ERROR backup of /var/mail/vhosts failed: tar: Removing leading `/' from member names tar: ...
0
votes
1answer
553 views

Help on writing Linux script to backup and ftp files to another server

I am using MySQL as the database system for my application on a Linux system. Every week I update the system and take backups (mysqldump) of the databases changed (2 databases). I then .tar.gz them ...
2
votes
3answers
526 views

diff for binary files

I have a folder with one big file. This is a file that changes each day. Using tar for incremental backups is not a good idea as that big file (each file that is changed is saved) will be copied each ...
1
vote
1answer
428 views

Creating diff from a tar

There is a tar file which was created few days before, this tar file was created on the /files directory. And now /files directory has new files uploaded in it. My question is how to create another ...