Today I was trying to find out why my server stalled after certain amount of requests on apache2, but couldn't figure why, so I decided to upgrade it(apt-get update & apt-get upgrade) before I gave my server a restart due to the fact I found it easier than killing the processes
I hadn't booted the server since I got it three months ago(FYI the server is from a German company, Hetzner) and to my surprise it didn't accept my key anymore nor my login credentials, after tearing my hair from my head I somehow ended up trying to login with the original login info I received and to my surprise it all worked too well
But I wasn't greeted with the same environment I had became used to, it was like the initial installement of debian, the server name and all, at this point I almost broke in tears, such frustration
I was googling up and found some promising results regarding faulty hard drive and RAID configuration being messed up and someone telling the host companys support was good, but after checking the raid configuration and health of the drives they all looked good
But the files are at the state they were when I received the server initially
How can this be? What could of happened? Only thing that comes to my head all this 3 months I've been ran from some virtual drive or something? And no changes were committed to the HDDs whatsoever? But I can't see how they're persisted now after numerous of reboots?
The other reasonable answer I can think of is that I had written all the data on the other drive and somehow the RAID failed to write on the other drive and BOOM now after reboot or something.. it decided to rewrite the drive that had no changes persisted on the other drive?
Or what could of caused such behavior after all, I am now hesitated to just start over, but I don't know how to deal with this if it happens again? I didn't have too complicated setup after all, but this kind of behavior just makes me lose my confidence even in managing a single small server
I decided to see if there's any data left for me to build upon and started opened up in the server providers rescue mode and stopped the array I was running and mounted the both drives separately on different places and checked and they both were as expected on the same state as they were initially, so basically good bye hours spend configuring postfix and so on, at least I am a experience richer, that doesn't really help me back on my foot with the question what really happened
I guess the only solid answer is that I somehow had my data written into one of the disk and after a restart it mirrored it to the other disk and boom, everything gone.