Take the 2-minute tour ×
Server Fault is a question and answer site for system and network administrators. It's 100% free, no registration required.

I am getting massive scrapers from Hostgator, theplanet, bluehost and dreamhost servers. I am tired of blocking their server ips manually. Is there anyway to get their ip ranges?

share|improve this question

closed as off topic by Michael Hampton, HopelessN00b, womble, rnxrx, Ward Oct 1 '12 at 9:06

Questions on Server Fault are expected to relate to server, networking, or related infrastructure administration within the scope defined by the community. Consider editing the question or leaving comments for improvement if you believe the question can be reworded to fit within the scope. Read more about reopening questions here.If this question can be reworded to fit the rules in the help center, please edit the question.

How do spambots work? Also, a search on webmasters.SE will turn up much more information on how to block particular IP addresses/ranges. It's a common question. –  Michael Hampton Aug 4 '12 at 4:29
@MichaelHampton That's not really relevant. Spambots and content scrapers are different. –  HopelessN00b Aug 4 '12 at 4:39
@HopelessN00b Actually they're quite similar; often they're exactly the same software. I've only been studying them for seven years or so... –  Michael Hampton Aug 4 '12 at 4:41
You should probably be looking at an IDS or something that will automatically react and block harmful behavior. –  Zoredache Aug 4 '12 at 18:11

1 Answer 1

That's not a DDoS, for one, and for another, this is easily answered with Google.

You want to do is a whois lookup. Look up the IP address blocks they own, and you can block them, if you so choose. Probably easier to do from existing IPs than domain name, but that would largely depend on the tool you use to do it.

Not that it's a good idea, but whatever. Kinda like trying to stop spam by blocking all the big hosted email providers, really.

share|improve this answer

Not the answer you're looking for? Browse other questions tagged or ask your own question.