We have a Rails 2.3.8 app running on a nginx/passenger server. Recently the crawlers generate a huge load on us. We'd like to turn on page caching ONLY for crawlers (specific IP addresses), i.e., crawlers get static pages which expire every day. Questions are:
shall we do it in Nginx or Rails?
how to achieve this IP-wise caching strategy
I googled for nginx and rails, but no luck so far. Appreciate any inputs!