I'm trying to create a rather unusual (imo) configuration where I have:
- 1000 seperate WordPress installs (with WP Super Cache). Each WP install corresponds to a separate subdomain.
Furthermore, I have 1000 cron jobs being called every hour that in turn call a WP plugin (using wget) which retrieves data from an API and posts it to the respective blog.
This is all being run on a virtual server with 1024MB of RAM, 4 shared processors, etc. The server is not doing well, especially during the times that the cron jobs are being executed. Nginx constantly throws 504 errors and the site has a significant lag.
Am I crazy for having 1000 individual WP installs? Should I be using WP-MU and will this help significantly? (I have certain plugin restrictions that I prefer having seperate installs but could switch if need be.)
Instead of having 1000 unique cron jobs - should be calling say a bash script that will then process the 1000 HTTP requests I need? Could this be done in a succesive order instead of a sequential one?
Any other kind of suggestion you may have for optimization? Should I be proxying to Apache instead of just using nginx, etc. Any kind of advice would be appreciated.
Thanks in advance
Update: Thanks a lot for your response. I'm going to switch to WP-MU and re-do the cron jobs. I'm currently using spawn-fcgi but will switch to php-fpm. Appreciate the advice