I'm trying to detect bad bot activity. If the information.php
, which is disallowed in robots.txt but is open for normal users, has been requested more than 500 times in a day by same IP address
, I'd say its a safe bet to mark the user as a bot.
Also, if I get more than 100 bad login requests
from an IP address, I'd like to mark that as bot activity. (although I think I'd be better off presenting the user with a captcha after 1 bad login attempt, but an IP-based solution will be a bit difficult to implement than a session cookie based solution IMO)
And finally, I'd like to block the IPs that have been marked for bot activity. How do I go about doing all this?