0
votes
2answers
57 views

Backup strategy for millions of files in lots of directories

We have millions of files in lots of directories, for example: \00\00\00\00.txt \00\00\00\01.pdf \00\00\00\02.html ... so on \05\55\12\31.txt backing up these to tape is slow as backing up data in ...
2
votes
1answer
132 views

Arranging a raidz3 ZFS vdev to tolerate entire JBOD failures?

Let's say I'm going to build a very large 1PB zpool. I'll have a head unit with the HBAs inside of it (maybe 4 port LSI SAS cards) and I will have perhaps 7 45-drive JBODs attached to the head unit. ...
4
votes
1answer
267 views

Should I exclude all 'dev/' or only 'dev/pts/' during full server tar backup?

I'm curious why in all backup tutorials I found tar command excludes among others /dev/pts and not all of /dev/ Why would I want to backup anything under dev?
0
votes
1answer
26 views

Tools or scripts to transfer files of a specific criteria to a USB drive

The company I work for has a 'company wide' share that is mapped on all of our machines. Over the years this has grown into the terrabytes and now lucky me has been tasked with bringing this back ...
1
vote
2answers
73 views

Is it a good idea to take onsite/offsite backups of server images?

Assuming a non-virtualized environment it a good idea to take actual images of servers (using something like Acronis True Image) and store them on\off site? Backing up data is great but I feel it ...
4
votes
3answers
215 views

Store multiple versions of large binary file with minimal data duplication (preferably Linux)

I need to store multiple versions of a ~ 150 GB binary file (qcow2) on Linux servers with local storage, and was hoping there is some solution that involves just keeping diffs that can be merged as ...
-3
votes
1answer
50 views

How to automate database backup of windows machines

I have a network containing 10 Windows workstations and 1 Windows 7 machine which acts as a server. I am planning to take a monthly backup of a folder called "MYFILES" which will be on all of the ...
1
vote
1answer
281 views

BackupExec 2012 File System Archiving - Access is denied to Remote Agent

Gentlemen, I've been struggling with a Trial version of Symantec Backup Exec 2012 for about a week now. It was installed as an upgrade to our 12.5 license, and the setup completed with no issues. ...
0
votes
2answers
3k views

How much resources should backup tools be using? ( issues with clBackup )

My hosting provider makes backups of our servers using a tool called clBackup which pushes files over the network. Below is one ps output we took and reported to our provider: top - 10:06:24 up 25 ...
1
vote
1answer
55 views

Speeding up directory creation / file linking

I'm using rsnapshot for backups. Currently that means every time an update runs (even without any data difference) I get a copy of ~100M of only the directory structure + inode list. The files are ...
6
votes
6answers
740 views

Dedicated server automatic backup solution

I have a dedicated Ubuntu web server in a cloud environment, and I am looking for a nice way to do automated backups. I would like to backup some directories with web apps, and all my MySql ...
0
votes
1answer
236 views

Sync Local Folder to FTP

I'm looking for an app I can put on my local server that will take files from C:\Source to a folder on my remote FTP Server every hour. I was looking at rsync and it looked perfect until it told me I ...
10
votes
4answers
942 views

Best way to prevent the root system filling up when a mount fails?

We have an internal web server (virtualized, hosting ReviewBoard, but not super relevant) and we have a relatively consistent failure mode with failed NFS mounts causing / to fill up. Distro is Ubuntu ...
2
votes
1answer
331 views

Do you have to partition before running mkfs on a single partition disk?

I see that some people don't use fdisk to create a partition on /dev/sdb... what is the difference between making and not making a partition for a single partition disk? I just added a partition on a ...
1
vote
4answers
229 views

file-system incremental backup - ideally with no downtime for the web site

I am trying to design a web site with backup in mind. Large media elements would be stored on the file system and a daily backup would be done both for the DB and the file-system (which would hold the ...
3
votes
5answers
384 views

Backup unix files to filesystem which doesn't allow chgrp/chown etc

I unfortunately have no choice but to backup some files from a ext3 parition on a server to a filesystem which does not allow me to set and edit the normal file attributes (NFS, with all_squash set so ...
2
votes
3answers
1k views

Optimal file system type and mount options for an rsnapshot dedicated drive

We have an external USB 2 drive that we are using as a backup drive for our configuration. We use rsnapshot for the backups. It uses a few standard commands for managing snapshots: rm -rf: deletes ...
2
votes
2answers
307 views

file system sync

I'm currently using rsync to keep a copy of a filesystem. This rsync constantly runs and keeps the backup up to date (in theory, its not particularly reliable). Is there a better way to keep a remote ...
1
vote
1answer
235 views

Generating error correction data for existing files (backups)

My server has a big dataset stored on disk. I am worried by the possibility of the data being silently corrupted over the years without anybody noticing. My idea was to generate "recovery data" for ...
3
votes
1answer
153 views

How to back up a versioned filesystem (e.g. ext3cow)?

I have been looking at versioned filesystems but I can't find any information on how to back them up. If my disk dies and I have to restore from a backup, I want to be able to restore the filesystem ...
3
votes
3answers
2k views

Robocopy hiding folders on backup drives

I have a backup batch file that uses Robocopy to backup my files (note this example contains newlines that you should remove): robocopy "C:\" "G:\Default\RoboCopyBackup\C" /XF Pagefile.sys /XD ...
2
votes
5answers
6k views

Alternative to robocopy /MIR

We run a number of web apps that store a lot of local data in small xml files. One part of our backup / recovery strategy is to produce a local mirror of the file system via a VPN to the hosting ...
0
votes
2answers
86 views

Unix / Linux: backing up an app installation

I was having a discussion recently regarding the fact that *nix doesn't use things like a registry (in the Windows sense) and how this means that everything related to an application (or anything for ...
18
votes
10answers
13k views

Linux - What directories should I exclude when backing up a server?

I'm backing up a linux server and storing it on some other server. I started off with a simple rsync -aPh --del server.example.com:/ /mnt/backup Then someone pointed out that I shouldn't back up ...
2
votes
4answers
2k views

UNIX/Linux sparse files — in use? How do you handle these?

Since the beginning the standard UNIX/Linux systems support sparse files, this is a file which contains unused space that is unallocated until needed. To review, to generate via a C program: create a ...