Tell me more ×
Server Fault is a question and answer site for professional system and network administrators. It's 100% free, no registration required.
up vote -4 down vote favorite

I am getting massive scrapers from Hostgator, theplanet, bluehost and dreamhost servers. I am tired of blocking their server ips manually. Is there anyway to get their ip ranges?

share|improve this question
How do spambots work? Also, a search on webmasters.SE will turn up much more information on how to block particular IP addresses/ranges. It's a common question. – Michael Hampton Aug 4 '12 at 4:29
@MichaelHampton That's not really relevant. Spambots and content scrapers are different. – HopelessN00b Aug 4 '12 at 4:39
@HopelessN00b Actually they're quite similar; often they're exactly the same software. I've only been studying them for seven years or so... – Michael Hampton Aug 4 '12 at 4:41
You should probably be looking at an IDS or something that will automatically react and block harmful behavior. – Zoredache Aug 4 '12 at 18:11

closed as off topic by Michael Hampton, HopelessN00b, womble, rnxrx, Ward Oct 1 '12 at 9:06

Questions on Server Fault are expected to relate to professional server, networking, or related infrastructure administration within the scope defined in the FAQ. Consider editing the question or leaving comments for improvement if you believe the question can be reworded to fit within the scope. Read more about closed questions here.

1 Answer

up vote 1 down vote

That's not a DDoS, for one, and for another, this is easily answered with Google.

You want to do is a whois lookup. Look up the IP address blocks they own, and you can block them, if you so choose. Probably easier to do from existing IPs than domain name, but that would largely depend on the tool you use to do it.

Not that it's a good idea, but whatever. Kinda like trying to stop spam by blocking all the big hosted email providers, really.

share|improve this answer

Not the answer you're looking for? Browse other questions tagged or ask your own question.