81

I almost cringe to do this, but if you're serious about recovering your data, and you don't have backups, you'll need a higher-end data recovery service. Watch out for fly-by-nights shops that will be peddling/scamming in your area, and go with an actual top-tier data recovery service. (And be prepared to pay $$$$ for it.) Here's a list of what to look at: ...


46

There are already many companies providing services for this, for example 24HourData (their site has a list of drives they support). While you figure out your next steps keep these things in mind (from Top Tips for Liquid Damaged Data Storage Devices) Do not try to power on a flood damaged hard drive bad things happen to good hard drives when this ...


38

You have a double disk failure. This means your data is gone, and you will have to restore from a backup. This is why we aren't supposed to use raid 5 on large disks. You want to set up your raid so you always have the ability to withstand two disk failures, especially with large slow disks.


37

Your options are: Restoring from backups. You do have backups, don't you? RAID is not a backup. Professional data recovery It's possible, though very expensive and not guaranteed, that a professional recovery service will be able to recover your data. Accepting your data loss and learning from the experience. As noted in the comments, large SATA disks ...


36

Easy enough. The // sequence isn't a comment in bash (# is). The statement OUT_DIR=x // text had no effect* except a cryptic error message. Thus, with the OUT_DIR being an empty string, one of the commands eventually executed was rm -rf /*. Some directories placed directly underneath / weren't removed due to user not having permissions, but it appears that ...


24

After you accepted a bad answer, I am really sorry for my heretic opinion (which saved such arrays multiple times already). Your second failed disk has probably a minor problem, maybe a block failure. This is the cause, why the bad sync tool of your bad raid5 firmware crashed on it. You could easily make a sector-level copy with a lowlevel disk cloning ...


23

If you're attempting to run xfs_repair, getting the error message that suggests mounting the filesystem to replay the log, and after mounting still receiving the same error message, you may need to perform a forced repair (using the -L flag with xfs_repair). This option should be a last resort. For example, I'll use a case where I had a corrupt root ...


17

I know @HopelessN00b already mentioned this, and I'm not affiliated with them, but try this: Kroll Ontrack From what I can tell, they handle some of the most difficult data recovery cases, including server, RAID, and forensic data recovery. Given that this is one of the leading data recovery companies, expect to pay dearly for their services. More ...


11

Is it possible for each platter in a multi-platter drive to be separated, cleaned, imaged, and merged into a new virtual drive for data recovery? As you would have read in other articles, the answer to this question is "yes". What you would not have read yet is that it is not an unconditional "yes". Data recovery companies would do what is called a "best-...


11

Old NeXT hardware. SWOON! Getting a SCSI2 -> SCSI 1 adapter should be trivial. There were both internal and external varieties. Google is your friend. For some reason I thought the "newer" slabs should be SCSI2 but it's been a long time. You still have to terminate the SCSI chain. Keep to addresses 0-7. Further just Googling for "scsi-2 pci card" comes up ...


10

It depends on how the drive failed. 72GB 10k disks haven't been manufactured for years, so I'd suspect that your disks are at least 6 years old... possibly 9 years... You may have a mechanical problem with the disk. The server you're talking about is an HP ProLiant DL360 G5. They were sold from 2005-2008. Running RAID 0 is a calculated risk. Your data was ...


8

I've done a bit of research into your problem. Not easy but looks feasible. The area of code breaking you is this (well, in newer kernels): fs/xfs/libxfs/xfs_sb.c 271 /* 272 * Until this is fixed only page-sized or smaller data blocks work. 273 */ 274 if (unlikely(sbp->sb_blocksize > PAGE_SIZE)) { 275 ...


8

You can tell photorec explicitly which block device to work with, e.g. photorec /dev/vda1. It must not be mounted. Of course, before photorec, you should try using extundelete, which may undelete your files on an ext* filesystem more quickly. Again, it must not be mounted. And of course you should be prepared to go to your backup.


8

1) He erroneously assumed that // was a bash comment. It is not, only # is. The shell interpreted // text as a normal command, and did not find a binary called //, and did nothing. In bash, when you have a variable assignment (OUT_DIR=/data/backup/mongod/tmp) directly preceding a command (// text), it only sets the variable while running the command. ...


7

F2 is typically the right option to choose... Otherwise the ESXi server would not have booted. My concern is what happened leading up to this incident... Did you receive any errors? Any indicators on the hard drive LEDs? Typically, an HP server's disks won't just crap-out on you. Considering you're using 750GB disks in RAID5, the chances are that the ...


6

It is my command line: dd if=/dev/sda bs=4M | gzip -c | split -b 2G - /mnt/backup_sda.img.gz It will create 2GB files in this fashion: backup_sda.img.gz.aa backup_sda.img.gz.ab backup_sda.img.gz.ac Restore: cat /mnt/UDISK1T/backup_sda.img.gz.* | gzip -dc | dd of=/dev/sda bs=4M Hope it helps.


6

I had the same problem... to address this issue I created a Mac OS X kernel extension which maps simple Linux LVM layouts to logical partitions in Mac OS X: https://github.com/unsound/IOLVMPartitionScheme It's available under an open source license (LGPLv2.1). It's not a complete volume manager, obviously, so only single-disk LVM layouts can be expected to ...


6

I had a similar problem: after a failure of a software RAID5 array I fired mdadm --create without giving it --assume-clean, and could not mount the array anymore. After two weeks of digging I finally restored all data. I hope the procedure below will save someone's time. Long Story Short The problem was caused by the fact that mdadm --create made a new ...


6

If these files are critical to your client and critical to your keeping them as a client then: STOP NOW. SHUT DOWN THE SERVER AND STOP ACCESSING THE HARD DRIVES. NOW. Then start looking for a data recovery company who can recover the data from the hard drives.


6

It appears that your hard drive has had a physical failure, and that it has affected a block containing the ext3 journal. You will need a second blank hard drive, at least as large as the failed drive partition, to perform any sort of recovery of this disk. You will also need a destination to copy recovered files to, so let's call it a third blank hard ...


6

Michael Hampton's answer is most correct, though I've posted about this before. The easiest way of moving the files over to the new mountpoint is: # cd /var/www # vi /etc/fstab # (add the new disk to the fstab now so you don't forget!) # mount /var/www # mv * /var/www


6

If you run mkfs.ext4 -n /the/partition it will print out what a EXT4 formatted drive would look like on that system. # mkfs.ext4 -n /dev/dm-3 mke2fs 1.42.8 (20-Jun-2013) Filesystem label= OS type: Linux Block size=4096 (log=2) Fragment size=4096 (log=2) Stride=0 blocks, Stripe width=0 blocks 3276800 inodes, 13107200 blocks 655360 blocks (5.00%) reserved for ...


6

So lets see if I got this straight: You had two Western Digital HDDs in a RAID 0 array. You removed them and replaced them with some Seagate HDDs, and created a new RAID 0 array. You then replaced the Western Digital HDDs, possibly in a different order to the one they were in originally, and created a brand new RAID 0 array. Have I missed anything? What ...


5

It's not available for download yet and we don't deal with unreleased code on serverfault. Come back, or better yet read the documentation, once it's released rather than announced. That said basically you just upgrade your VC and hosts to 5.1 and deploy the VDP .ovf like you did for VDR, the process is the same.


5

It's always nice to see a new serverfault user that's already got the right answer in mind :) Basically what you suggest is spot-on, there are some SCSI-to-USB devices out there (I think Adaptec did their own at one point) that may make it a bit more portable but essentially that's exactly the way to do it.


5

The answers above did not help me when I had this issue today (about 9.5 hours ago now). I'll present here the solution that worked for me, along with the reasons why the previous answer did not help. Symptoms Out of nowhere, any file in /home could not be saved/edited, etc. or any directory listed. dmesg showed somewhere xfs_do_force_shutdown called ...


5

I hate to say this, but do you know that you were basically adding unraided disks to your pool? The command you provided basically says, "Add another disk to pool nas and stripe it with the existing disks." Is that what you meant to do? The pool is done at this point, especially if anything was written to the bad disk. If this were a pair of mirrors, the ...


5

You can use a loop mount to mount a partition in your disk image as a device. When creating the loop device, you give an offset which makes the loop device begin at that spot in the partition. This way you can skip the missing MD superblock, and make the loop device start at the start of the ext4 partition or possible LVM. Now, we need to know the size of ...


5

Deleting a VMDK file is a bit like removing physical hard drives from a server and throwing them away. Too bad. Fortunately, this kind of thing is exactly what backups are for! Your best bet is to consult your backup/disaster recovery plan and begin a restore from backup immediately.


5

Why are your servers crashing so often? In case of power failure: Get a RAID controller with backup battery / capacitor Get SSDs with build in capacitors, so they have time to write their cache Get a UPS to prevent power failures from shutting down servers //EDIT// As EEAA pointed out below, also connect the UPS to the servers so it can trigger graceful ...


Only top voted, non community-wiki answers of a minimum length are eligible