I'm interested in sending Apache2 access logs directly to CouchDB or some other document storage system. Do you know of any Apache2 modules that do this, or what options there would be to write one myself?
asked Jul 31, 2009 at 22:14
-
Interesting idea, I guess you don't really need normalization to store logs– chmeeeJul 31, 2009 at 22:15
-
What you may wish to look at in logs may change over time, so why tie down a schema? Also log events are typically not tied together relationally at log event time, but through analysis in reporting.– Scott MarkwellAug 2, 2009 at 22:22
Add a comment
|
3 Answers
mod_ log _sql can log directly to MySQL. When the data is so nicely normalized, why go and toss it all into a key->value system like Couch?
-
I guess it's the same reasons why they exist for other uses :). No everything needs to be normalized and key/value dbs have other advantages.– chmeeeAug 1, 2009 at 9:10
-
Sure they do -- but taking perfectly good normalized data and denormalizing it to toss into a blob that you would need to unnormalize later doesn't seem like a great use case for them :).– SirStanAug 1, 2009 at 16:37
-
why do you assume it would be denormalized? My intention would be to generate one document per log event, with each document containing each piece of information in the log. The desire to use such a system is because the data is write heavy, doesn't need transactions, and will be used primarily for data analysis, all things couchdb (and similar systems) excel at. Not that MySQL can't be setup the same way, just this is where my curiosity currently is. Aug 2, 2009 at 22:20
I've started writing a module which does this it's still at an alpha stage at the moment but you can take a look, I can't confirm it will compile on anything other than Linux at the moment though! https://sourceforge.net/p/mod-log-couchdb/
