Take the 2-minute tour ×
Server Fault is a question and answer site for professional system and network administrators. It's 100% free, no registration required.

So currently a bot hammers our server and causes high server load / dropped responses. I don't want to stop the bot as it has a purpose but I would like to slow it down.

I've implemented squid to block requests above 20 but that returns a forbidden for anything above those 20 connections. I've looked into mod_evasive and that does something very similar which I don't want and I believe would work per domain, not across all domains on the box.

Basically I would like to queue the response till the requests drop below 20. I have a feeling this isn't possible but thought I would ask.

Any thoughts?

share|improve this question
    
Contact the bot owner. –  Michael Hampton Sep 13 '12 at 7:32
    
Our company owns the bot, they don't have the ability to slow it down unfortunately. –  Rudiger Sep 13 '12 at 7:45
    
In that case, contact the bot developer. –  Michael Hampton Sep 13 '12 at 7:47
1  
Put nginx upstream (or replace Apache with it if possible) and impose a rate limit on the bot: wiki.nginx.org/HttpLimitReqModule –  mcauth Sep 14 '12 at 3:19

Your Answer

 
discard

By posting your answer, you agree to the privacy policy and terms of service.

Browse other questions tagged or ask your own question.