If you're starting from zero (no directory services at all), I'd recommend looking at Active Directory as Apple has good support for connecting Macs to AD, and it should also be possible to have your Linux servers leverage it as well. If you don't want to set up Windows servers in your shop, you can use Microsoft Azure to host your Active Directory services:
http://www.windowsazure.com/en-us/services/active-directory/
If you have an OpenLDAP server already running, you can set up your Macs to connect to your OpenLDAP server using the Mac's LDAP plug-in. I've got a script available on GitHub that will Macs running 10.6.x through 10.9.x to connect to an OpenLDAP server using a simple anonymous bind.
https://github.com/rtrouton/rtrouton_scripts/tree/master/rtrouton_scripts/open-ldap_bind_script