Take the 2-minute tour ×
Server Fault is a question and answer site for system and network administrators. It's 100% free, no registration required.

I'm badly affected with 'Google AppEngine-Google' UserAgent.. receiving 5/6 requests per second on http server. This bot is crawling my site just like GoogleBot does.

Following is the sample of url in my access logs.

72.14.192.3 - - [19/May/2010:01:27:06 +0000] "GET /some-url/etc-123.htm HTTP/1.1" 200 4707 "-" "AppEngine-Google; (+http://code.google.com/appengine; appid: harpy000)"

I have checked the ip address it is registered with Google Inc.

Can anyone tell me where i can report Abuse to Google Inc. Or any information about this issue.

Thank you!

share|improve this question
1  
you consider 5-6 requests per second abuse? WHat is your definition of low load? 1 request per minute? 5-6requests per second are not massive crawling, they are "no load". –  TomTom May 19 '10 at 6:31
    
:-), 5 to 6 requests per second doesn't impact any load but nobody would like illegal crawler. Bad crawler should be block straight away. Rough analysis shows, he is a Developer hosted his application on Google AppEngine and and crawling data illegally. –  Alam May 19 '10 at 8:21

1 Answer 1

up vote 2 down vote accepted

You can report Google App Engine abuse using the following form: http://code.google.com/support/bin/request.py?contact_type=AppEngineContact. The App has a web page at this address: http://harpy000.appspot.com/. There is also a link to a Twitter page (the owner?), maybe you can contact him.

share|improve this answer
    
Thank you @PowerSp00n. I have reported the abuse to Google Inc. –  Alam May 19 '10 at 8:16

Your Answer

 
discard

By posting your answer, you agree to the privacy policy and terms of service.

Not the answer you're looking for? Browse other questions tagged or ask your own question.