I'm interested in sending Apache2 access logs directly to CouchDB or some other document storage system. Do you know of any Apache2 modules that do this, or what options there would be to write one myself?

  • Interesting idea, I guess you don't really need normalization to store logs – chmeee Jul 31 '09 at 22:15
  • What you may wish to look at in logs may change over time, so why tie down a schema? Also log events are typically not tied together relationally at log event time, but through analysis in reporting. – Scott Markwell Aug 2 '09 at 22:22

A start could be this thread.

| improve this answer | |

mod_ log _sql can log directly to MySQL. When the data is so nicely normalized, why go and toss it all into a key->value system like Couch?

| improve this answer | |
  • I guess it's the same reasons why they exist for other uses :). No everything needs to be normalized and key/value dbs have other advantages. – chmeee Aug 1 '09 at 9:10
  • Sure they do -- but taking perfectly good normalized data and denormalizing it to toss into a blob that you would need to unnormalize later doesn't seem like a great use case for them :). – SirStan Aug 1 '09 at 16:37
  • why do you assume it would be denormalized? My intention would be to generate one document per log event, with each document containing each piece of information in the log. The desire to use such a system is because the data is write heavy, doesn't need transactions, and will be used primarily for data analysis, all things couchdb (and similar systems) excel at. Not that MySQL can't be setup the same way, just this is where my curiosity currently is. – Scott Markwell Aug 2 '09 at 22:20

I've started writing a module which does this it's still at an alpha stage at the moment but you can take a look, I can't confirm it will compile on anything other than Linux at the moment though! https://sourceforge.net/p/mod-log-couchdb/

| improve this answer | |

Your Answer

By clicking “Post Your Answer”, you agree to our terms of service, privacy policy and cookie policy

Not the answer you're looking for? Browse other questions tagged or ask your own question.