Questions tagged [disaster-recovery]

Disaster recovery and preparedness is an unfortunate aspect of systems administration. This tag should be used for help with planning, implementation and best-practices related to recovering from a catastrophic event on a server or in a datacenter environment.

Filter by
Sorted by
Tagged with
0
votes
1answer
37 views

desperate attempt to head off RAID 0 failure, can i copy a disk with dd?

A colleague has been using a 10TB RAID 0 array to edit a film. He suddenly realized it's 98% full. The array has started seriously acting up, but cooperates grudgingly if you shut down all processes ...
2
votes
0answers
17 views

Systemd and Disaster-Recovery Stand-By systems

We're using systemd to run various services in production. (Duh...) We're building out a matching "disaster-recovery" site, which will have the same application installed -- with the same ...
0
votes
2answers
34 views

Cloud definition met? [closed]

note: question has been reviewed after suggestions it could be opinion based We recently suffered an outage due to a popular big provider's datacenter fire. Our public cloud instances hosted in that ...
0
votes
0answers
7 views

A 4th ElasticSearch node that has ALL the shards for offsite backup

I have a 3-node Elasticsearch 7.9.3 cluster. It consists of 3 master-capable nodes, and 7 indexes are spread as 2 shads on 2 of the nodes. I would like to have a 4th node, not master-capable, that has ...
0
votes
1answer
24 views

Disaster recovery process document for Google cloud Virtual Machine

Hello we have been directed by auditors to provide disaster recovery document for Google Cloud Virtual Machine. Please Is this provided by Google? If so how can I get it. I would appreciate resources ...
0
votes
0answers
39 views

btrfs find paths deleted between two snapshots

I have somewhat large data array, with periodic snapshots. I'd like to see a ~"diff" between two snapshots as I suspect an errant command has deleted data. Many TB so I can't just mount ...
-1
votes
1answer
58 views

Safe to delete managed incremental snapshots on Azure?

Incremental snapshots of managed disks on Azure is a relatively new thing, and is not completely documented, so I have a crucial question: If I have incremental snapshots A, B, C and D of a disk (the ...
0
votes
0answers
18 views

How to make backup for the Local Server

I have critical server that running the local company system, that have system backup and company files and business documents with critical and important severity. I'm planning to create a Network ...
1
vote
0answers
38 views

Setting UP disaster recovery , one region to multi region in Google Cloud

I'm new to GCP and also learning about Multi-Regional architectures . We already have single region ( but multi zonal ) infrastructure setup. DNS names of the internal components do not have region/...
0
votes
1answer
75 views

promox is blocked from fully booting by ifupdown2 start job

i have a promox server with ifupdown2 installed. recently when trying to reboot the entire server promox failed to get to console, it gets stuck on replication runner failing and the ifupdown2 service ...
1
vote
0answers
33 views

Is it possible to backup and restore a Netbackup Master server using Windows Server Backup?

I have installed Netbackup 8.2 master server on Windows Server 2019 system. I read this document , which says you neet to re-install OS and Netbackup itself, then the catalog in order to restore ...
0
votes
0answers
75 views

Can't reconnect VPS Essential OVH after removing set_hostname from cloud-init

I have a VPS Essential in OVH with Ubuntu 18.04 LTS installed. I just removed the set_hostname module of the cloud_init_modules from /etc/cloud/cloud.cfg and reboot the system and now I cannot connect ...
1
vote
1answer
44 views

How can I recover data from a five disk raid 5 on HP Proliant DL 380 [closed]

How can I recover data from a five disk RAID 5 on HP Proliant DL 380 where four of the five disks are reporting a SMART error. I have some critical data on the failed logical drive and checking online ...
0
votes
1answer
87 views

Azure VM off-site backups via CLI

I'm currently backing up Azure VMs via Azure CLI: create resource group: az group create -n backup-resource-group -l uksouth create recovery services vault: az backup vault create --resource-group ...
5
votes
2answers
490 views

In 2020 - are there any viable Linux block-level replication alternatives for DRBD? [closed]

I'm researching how can we implement near-realtime replication from primary datacenter to a disaster recovery site. Data that would get replicated would be: Images of KVM VMs MySQL and PostgreSQL ...
1
vote
1answer
268 views

Windows 2019 backup: bare metal restore

I'm rehearsing a virtual machine bare metal restore. Backups are taken daily and saved on a secure external server. We are assuming a total disaster, so bad that no domain controller is available, so, ...
0
votes
2answers
87 views

Copy binary file from other system with builtin shell commands only

I accidentally just have removed critical shared library and no one dynamically linked executable can't be run now. For example, even /bin/ls shows error while loading shared libraries: libunwind.so....
0
votes
1answer
63 views

AWS DR Setup and runbook

I'm working on creating a DR setup and runbook based on AWS. I don't have any experience with creating DR setups so it would be really helpful if the experienced veterans can guide me through it. ...
1
vote
0answers
133 views

Zerto Failover - Win 2012/16 Servers Get Stuck on “Getting Devices Ready”

We are using Zerto to replicate our VMs to an offsite datacenter. During our failover tests the VMs have a tendency to "hang" from 15 minutes to several hours on "Getting Devices Ready." I have read ...
-1
votes
1answer
570 views

Does Barman need ssh connection setup when installed on the same host as the PostgreSQL host?

I'm trying to configure Barman (pgbarman) to work alongside the PostgreSQL database on the same host, i don't want to install barman on a separated host, but I can't find any documentation about such ...
5
votes
1answer
115 views

Recovering lost VHDX / VM (deleted by Veeam)

Earlier this week a VM on one of our hypervisors experienced extended downtime (~24 hours) due to some Windows updates going wrong. I ultimately was able to fix the issue, and noticed yesterday that ...
0
votes
1answer
443 views

Data recovery failure from Azure Data Recovery Vault using MARS Agent with on-premises computer

Despite trying several times since last night, the recovery of a volume from an Azure Data Recovery Vault to a new location on the original source computer fails after approximately (but not exactly) ...
0
votes
0answers
87 views

moving raid 5 hard disks from ibm x3500 m1 to ibm x3650 m1

one of our server ibm x3500 m1 type 7977 dead yesterday. can we move its hard drive to access data on raid 5 logical drive on ibm x3650 m1 server with same serveRaid 8K raid controller? Usman
9
votes
3answers
3k views

Database accidentally deleted with a bash script [duplicate]

Edit: a follow-up question: Restore mongoDB by --repair and WiredTiger. My developer committed a huge mistake and we cannot find our Mongo database anywhere in the server. He logged into the server, ...
1
vote
2answers
835 views

BTRFS unmountable after cold reboot (total_rw_bytes is twice too big)

One of my users in research environment invoked out-of-memory on a server which mounts a 52TB btrfs partition. I had to power cycle the server. After the reboot my btrfs partition cannot be mounted in ...
1
vote
1answer
58 views

Azure VM Site Replication

I'm looking to set up site replication for our Azure VM's. My question is this, how often are the VM's backed up/replicated to the DR site? Is this replication automated or would I need to kick off ...
0
votes
1answer
49 views

What happens to data in a GCP project if all owners or the project itself is suspended?

I have realized recently that a personal domain on google apps for business got suspended (the free for life version that was available in beta). This actually happened like 6 months ago and I didn't ...
2
votes
1answer
1k views

Recover ZFS data

Context/Hardware: HP microserver gen8 1x1TB - standalone, 2x4TB Raid 1x16GB iLO SDCARD with Debian + OpenMediaVault Event: SDCARD failure restarted server and installed Ubuntu on 1TB drive ...
1
vote
1answer
107 views

btrfs recover: reliable or last-straw?

The chunk tree of a btrfs filesystem corrupted and I could not recreate it after hour-long reconstruction. As a last resort (besides restoring from backup) I could use btrfs restore -S -x -m -v to get ...
1
vote
0answers
52 views

Recovering VCS 2 node cluster in DR?

We are looking for a solution to recover the 2 node VCS Cluster at DR location for a DR Test. Prod: Hardware is Dell with 24 cores 64 GB RAM with Suse 11.4 Linux over SAN Boot & 4 NIC's of 1 Gig. ...
0
votes
1answer
53 views

Can I shadowcopy/backup the AD search index?

We have a 1TB+ search index in our Server 2012 Active Directory (6.1) domain. This is located on a NAS, so rebuilding it takes "forever". For DR purposes, is there a way to correctly back up the ...
1
vote
0answers
60 views

Tried to recover a Ext4 Superblock to a CEPH disk

We have a server with Proxmox installed with Debian, it's an dedicated server (sda). The VM's are being backed up every night on a CEPH disk (sdb). After an reboot of the dedicated, the ext4 drive ...
0
votes
0answers
29 views

Possibility to recover from majority of C:\windows being deleted

So I have an interesting and somewhat fun scenario. A developer was working on some scripts that have worked in the past when run by him which deleted files in the working directory, but supposedly ...
1
vote
1answer
82 views

Can I restore a SQL Server instance from file backups only?

Our windows 2016 server failed to restart after a windows update yesterday. In order to avoid the update that crashed it issue (whatever it was), I'm in the process of rebuilding it clean. So I've ...
0
votes
2answers
495 views

Recover a failing node on Percona 5.5.41-37.0-55

I have a 3 node percona cluster of where 1 of the nodes has, because of a server crash, InnoDB log sequence problems. 180425 17:32:53 InnoDB: Error: page 151555 log sequence number 12431827692 ...
0
votes
0answers
63 views

Recovering software raid after a hardware raid array was created on the disks

I had a server with 4 x 500GB SSDs in a software RAID10 array. I moved these drives to a new machine that had an HP P410i Hardware RAID controller. I didn't want to use the hardware raid controller, ...
0
votes
1answer
64 views

Azure Site recovery

Planning for ASR and migrating all our servers to Azure in distant future from VMware. Issue is that we do not have any VPN capable device in the network and have read that it is necessary. Can ...
1
vote
2answers
318 views

What would cause mysqlcheck to incorrectly report a table as undamaged?

We are administering a MySQL server for one of our customers that has >100 databases with about 50 tables each, many of them InnoDB tables. The server crashed and I'm trying to find the culprit. When ...
0
votes
0answers
2k views

Synology: How to restore data from an accidentally deleted volumeX (BTRFS)?

The Synology in question has a RAID6 configured via mdadm which features a BTRFS filesystem mounted to /volume1. This path was mounted into a Debian chroot. The unmount was configured in the chroot ...
1
vote
1answer
521 views

Simulate power loss with force unmount?

I want to test disaster recovery of RDBMs after power loss under high load. My idea is to mount data directory under new mountpoint and then execute umount -f during the load and investigate outcome /...
4
votes
1answer
2k views

Cannot login to restored domain controller unless NIC removed

We have four DCs (Windows 2008 R2) running on VMware, backed up with Veeam. Currently doing some DR testing. If I restore a DC (full VM) from backup (obviously isolated from our production ...
4
votes
2answers
660 views

Is it compulsory to pick only a region pair as Azure DR region?

Certain Azure VM types (like some in G & M series that I require) are not available in the Azure region pair (US East, US West). Will there be any constraints on functionality if I choose an ...
0
votes
3answers
2k views

Mysql server crashes without leaving any log behind

I've a mysql server (v5.6) running on ubuntu server 10 x64. It's always up and running with a medium traffic, but every while it crashes & restarts without lefting any log message behind, after ...
0
votes
1answer
319 views

Cloudberry bare metal recovery network share access

I am doing a test backup and restore with cloudberry and running into an issue. My server is a Windows server 2016 version, running on vmware esxi. I have used Cloudberry to backup to a share folder ...
1
vote
1answer
793 views

create bootable ISO from USB flash drive recovery media with imgburn or other tool

I need clean my HDD and partitions but first did a recovery usb drive with the recovery tool, the recovery is one of Thinkpad E431 and was done right. I cant rely only on a fragile usb drive to keep ...
4
votes
2answers
178 views

Build mirroring on top of SQL2008R2 SQL cluster

On our SharePoint 2010 farm, we are using SQL 2008 R2. Currently, a SQL cluster (with 2 SQL server sitting at same data center) is built to provide auto-failover. However, it has no DR ability. We ...
3
votes
3answers
865 views

How to do a snapshot of a Datastore on esxi vmware - datastore snapshot as fast recovery backup

I have a server with hundreads of vms and the snapshot is very useful to me, on incidents i can restore a vm to a point on time in no time, but i have many datastores where operational data is stored ...
1
vote
1answer
230 views

Can Azure Backup and ASR protect the same workload?

I plan to use both Azure Site Recovery for high availability & DR of on-prem workloads replicated on Azure & Azure Backup for safety & recoverability of data related to the same set of ...
2
votes
1answer
2k views

MongoDB Active-Active Multiple Datacenters

I am looking for a method to configure MongoDB servers across 2 different datacenters where they remain in an active-active configuration. Site A is the normal Production environment that customers ...
7
votes
1answer
2k views

How do I configure a stretch cluster without shared storage between two sites?

I am trying to redesign our IT infrastructure and seeking help in implementing DR solution for our company. I see that as 2 data centers in active-passive mode with the data replication. Currently ...

1
2 3 4 5
7