Take the 2-minute tour ×
Server Fault is a question and answer site for professional system and network administrators. It's 100% free, no registration required.

For the fun, I'm curious to save all web traffic I send/receive. Is there any FLOSS web proxy software that runs on Ubuntu Linux that will just save, to a file, the headers, url, datetime and the content of all HTTP traffic that moves through it? If there isn't, I'll just write my own, but no point re-inventing the wheel.

UPDATE The reason I want this is just cause I'm a bit of a data hoarder. And I'm wondering is there is some sort of way to record all my web traffic.

share|improve this question

4 Answers 4

Squid will do this quite happily. Installation should be no more than apt-get install squid, and the config should be fairly trivial too.

share|improve this answer
1  
Squid will do the proxying fine, but it's the logging and 'record everything' that I'm looking for. –  Rory Dec 21 '09 at 10:22

You can do this with tcpdump too. It's a bit agressive , but it can capture all the traffic sent or received from a webserver (port 80/tcp)

tcpdump 'src port 80 or dst port 80'

From client side and using firefox, you can use the slogger extension, that dumps all data sent or received by firefox in differnt formats

share|improve this answer
    
Yes I had used slogger, and that's the sort of thing I want to have. I was thinking that a http proxy was 'the right way to do it'. –  Rory Dec 21 '09 at 10:23

squid mentioned by Tom O'Connor will be probably best solution. but if you want completly passive tool that can work on the mirroring port [ in opposite to the squit that works 'in-line' ] - take a look at httpry - specialized sniffer for analyzing http traffic. it's small and quite flexible.

share|improve this answer

Tinyproxy do what you want: proxying fast and logging (without cache). But even squid with disabled caches is identical.

share|improve this answer
    
Can't downvote this, but to best of my knowledge Tinyproxy can't log HTTP request bodies or headers out of the box. It's just URLs that are logged. Or I'm really missing something. –  drdaeman Mar 29 at 10:38

Your Answer

 
discard

By posting your answer, you agree to the privacy policy and terms of service.

Not the answer you're looking for? Browse other questions tagged or ask your own question.