I'm looking for a production solution to create a RAM drive that will be safely synchronized with HDD.
I have a piece of custom software with heavy I/O load (this is some kind of proprietary document-oriented DB), and I need to speed it up dramatically. I can't modify or get rid of the software itself, so have to do either horizontal or vertical scaling. The software doesn't support horizontal scout of the box, so I'm looking at vertical scaling first.
The main idea is simple - we buy loads of RAM (96GB) and put whole thing onto a RAM drive. But it needs to be failsafe, loosing any data on server reboot is not an option. So I'm looking for solution that will maintain transparent synchronization between RAM drive and HDD.
Dirty solution like copying files through bash script is not an option, need something more reliable.
In theory as I see, some kind of distributed FS like described here can be used in a weird way - to synchronize two partitions on the same machine. But i doubt if this will work in practice, and never tried that.
So, any ideas on ready solution for a RAM drive with transparent synchro to HDD?
- The estimated amount of data I will need to hold in RAM is about 50GB.
- Servers are dedicated HP DL320, 8 CPU, 16GB RAM (up to 96GB).
- I/O profile is similar to a database application - lots of random access reads, less writes.