Deploying, and managing this site has become a nightmare. Deployment, going from development to QA, and pre production, takes a couple of days. We have lots of errors, and it involves a lot of manual labor. We often have config files that have been updated or changed incorrectly, and then the entire site on that web server fails.
- Plenty of web front end servers (windows 2003, IIS6)
- Plenty of MemCached Servers (Linux)
- Multiple database servers (SQL 2005)
- Approx 5 million unique per month
I am one of the developers that are responsible for developing the system. Currently there is zero automation, zero automated testing, and the deploy process involves logging into the servers, with terminal server, and manually changing IIS settings, updating config files, and similar horror's. Disaster recovery documentation leaves a lot to be desired.
I would like to enable the team that handles the operations of the servers, to successfully deploy and maintain the application that I am working on. So for partly very selfish reasons, I want them to succeed.
I would like some direction; on what are specific questions I can ask them, or suggestions that I can make, on how as developers we can create things to help them be more successful.
Currently there is a bit of mudslinging going on, and I figure the only way to really fix that is to ignore the mudslinging, and focus on the problem. And the problem currently is that it is VERY labor intensive to maintain, troubleshoot and deploy the site.