I would like to know if you have an experience or any idea about how to set up nagios in big scale.
Previously we used nagios and nagiosql for manual settings, it was pretty comfortable for few servers.
Recently number of server has changed and manual configuration by nagiosql became uncomfortable. We use chef for starting new instances, I would like to know if there are good practices for using chef and nagios together. As one option, we can use just nagios and rewrite configuration files of nagios (based on server role) every time when we start new instance.
For example, the scenario could be like this, having started new mysql server, there is a dedicated recipe for rewriting nagios setting file. Recipe can get all data from chef data-bags about every server and build settings based on roles in chef.