Server Fault is a question and answer site for system and network administrators. Join them; it only takes a minute:

Sign up
Here's how it works:
  1. Anybody can ask a question
  2. Anybody can answer
  3. The best answers are voted up and rise to the top

I have a problem with one of my servers. Google opens lots of http connections to the apache server and basically performs a slowloris attack.

This netstat call results in the following output

netstat -plant|grep :80|awk '{print $5}'|cut -d: -f1|sort|uniq -c|sort -n


All of these ip's belong to the google network. I've already forbidden Google to access any of the content that is saved on the server by using robots.txt but it has no effect on the insane amount of connections. What should I do?

share|improve this question
I'd stick the IP addresses into an iptables rule to block them - not putting this as an answer because my iptables skills aren't up to scratch - but an iptables drop will stop them using resources at your end – EightBitTony Jul 3 '11 at 19:39
Great Idea, Thank you! BTW the command is: /sbin/iptables -I INPUT -s -j DROP – Philip Jul 3 '11 at 19:46
google has how to on this link. – Sharad Chhetri Aug 25 '13 at 20:23

Go to google webmaster tools, put in throttling.

Several other spiders respect the Crawl-delay directive in robots.txt, but Googlebot doesn't.

share|improve this answer

Your Answer


By posting your answer, you agree to the privacy policy and terms of service.

Not the answer you're looking for? Browse other questions tagged or ask your own question.