Take the 2-minute tour ×
Server Fault is a question and answer site for professional system and network administrators. It's 100% free, no registration required.

How can i block all bots except a few including BPImage walker...it is creating a huge amount of load on web site and consuming lots of bandwidth

share|improve this question

closed as not a real question by Ward, EEAA, petrus, rnxrx, pauska Oct 2 '12 at 23:32

It's difficult to tell what is being asked here. This question is ambiguous, vague, incomplete, overly broad, or rhetorical and cannot be reasonably answered in its current form. For help clarifying this question so that it can be reopened, visit the help center.If this question can be reworded to fit the rules in the help center, please edit the question.

1  
Make an effort and supply a LOT more details. What web server are you using, what firewall(s) do you have, what behaviour do the bots exhibit, what user-agents to they have etc. etc. etc. I want to do something, with something How can I write better questions on Server Fault - meta.serverfault.com/questions/3608/… –  Sonassi Oct 2 '12 at 19:54

1 Answer 1

try robots.txt and see if they honor it. If not try an apache rewrite rule.

share|improve this answer

Not the answer you're looking for? Browse other questions tagged or ask your own question.