Yandex.ru spiders are known of disobeying robots.txt. In Apache, you can disable yandex in htaccess file. How can I do the same thing with Tomcat? I'm using ubuntu server, so I thoght about appropriate entries in hosts.deny, but I'm not sure if
will be sufficient and efficient, cause bot's are often named like spider31.yandex.ru. Could you show example of blocking this bots via hosts.deny (or any other way)?