Take the 2-minute tour ×
Server Fault is a question and answer site for professional system and network administrators. It's 100% free, no registration required.

I have large quantities of structured data coming in over the network from disparate sources, and that data is archived in the filesystem, parsed/analyzed, and eventually makes it's way into a database (mysql) to be accessed by a few apps. The data is not relational-friendly, and has to be significantly massaged.

I would like to replace the 'archive to filesystem' step with some other system, one that has equivalent reliability (read: zero data loss) but has features of a database including query and api interfaces. It appears to me that one of the NoSQL products would be perfect for this, as they fulfill the query+api conditions and don't force me to shove the data into a structured format. I really like mongodb, but AFAGTM it (among other nosql products) sacrifices reliability and data integrity for performance. I was just about to set up a mongodb instance with journaling enabled, but wanted to be extra-special-super-sure before I did so.

I am not looking for a DMS or related system, as the data is more like log-ish than file-ish. And obviously I have backups etc.

TL;DR I'm looking for a NoSQL product that can act as an 'archive' in that it will never eat my data.

Thank you. Sorry for the novel.

share|improve this question
add comment

Your Answer

 
discard

By posting your answer, you agree to the privacy policy and terms of service.

Browse other questions tagged or ask your own question.