Take the 2-minute tour ×
Server Fault is a question and answer site for professional system and network administrators. It's 100% free, no registration required.

I need to set up a login/password protected SOCKS server, which would save all the requests and responses, this means both headers and bodies.

This will be used as a site scraper, so HTTP/HTTPS protocol only, since I couldn't find a working solution to run a tool like Selenium, so I guess I'll just parse these logs of the socks server.

Is there a way to log SSH tunnel in this manner? Can dante do it?

I will install it to CentOS 5.6, preferably with yum.

Thanks

share|improve this question
    
This is not how you implement a site scraper. –  Ignacio Vazquez-Abrams Oct 2 '11 at 19:52
    
@Ignacio Vazquez-Abrams, do you know a reliable browser manipulation library? I've tried Selenium and WebDriver and they sucked. –  Fluffy Oct 2 '11 at 20:09
    
@Ignacio Vazquez-Abrams, and I do need a browser, not even HtmlUnit will do. The site is likely be paranoid about scraping, so I'll need to see a browser window –  Fluffy Oct 2 '11 at 20:10
add comment

Your Answer

 
discard

By posting your answer, you agree to the privacy policy and terms of service.

Browse other questions tagged or ask your own question.