I'm building a 24 nodes php-fpm farm using three Supermicro MicroCloud (8 nodes in 3U, nice and tight)
At first, I was planning to have each of them nodes have a disposable HDD with CentOS on (6 or 5 doesn't matter) but later I think running them diskless will save money on HDDs initial purchase and replacements, save time on maintenance and on top of them all, I can be sure that they are all identical, failover would be easy and rebuilding crashed one would take zero effort (on software size)
So, I managed to setup a manager, yum a new installation with --installroot and boot all of the nodes with correct IP, hostname (provided by DHCPd) with the root fs mounted readonly from the manager.
In /etc/sysconfig/readonly-root I have $READONLY = yes, in /etc/statetab I have various files and directories which I think should be persistant between reboots.
Now onto the problem, all entries in /etc/statetab are appear at manager snapshot directory, some of them are so the NFS mount is working, but entries like /etc/sysconfig/network isn't (while /etc/sysconfig/network-scripts/ifcfg-eth0 is)
Is a long post for one problem but I'm posting them all here, hoping that if someone know any other way to achieve what I'm trying to do can guide me to the right direction.