I'm currently working with a cluster-configured application that stores all data locally for each child node. We're having issues scaling up properly and are looking into traditional SAN and Message-Based cluster configurations.
I'm interested in how to properly configure the data access for children/worker nodes and a single SAN. Would my manager node restrict data access to one child-node at a time, or would all children be able to read/write to the same volume on the SAN at the same time in a performant fashion? It would seem that the best option is to restrict access to one machine at a time through the manager node, but that limits data being accessed from a single child at a single time; which is hardly scalable.
The idea is to be able to launch a job which the manager node would alert all children nodes to run. Each node would grab a portion of data to process from the SAN.
I'm rather new to this area and would greatly appreciate any and all feedback/responses possible.
[SideNote: This is a Windows based server setup. We're thinking of trying out Windows Server 2008 HPC specifically, but are not currently using it.]