We currently have a Sun x4270 with 2xquad core Xeon Nehalmen 2.93ghz cores (16 threads), 72 gig of ram and 16 x 10k SAS disks split between the os raid 1, a partition for the Write Ahead Logs which is raid 10 and a partition for the database tables and indexes which is also raid 10, all xfs.
I'm currently evaluating which path to go down in terms of upgrades. We'll be sharding the DB at some point soon, but for now I need to focus on hardware upgrades specifically. The machine is not CPU or memory bound at all at the moment, just IOWait is become an issue. The machine is mostly write access as we have a heavy caching layer. We're seeing about 300 write IOPS average on both the database partitions.
We don't have any additional storage infrastructure like a Fiber Channel or ISCSI network.
Budget isn't too much of a concern, something inline with the size of this server (i.e no $1m IBM machines)
Space is ok on the DB side of things, we're running out obviously but there's also some reduction we can do. Additional space would be good though.
My current thoughts are either:
- ISCSI SAN, possible with 10Gbit network that has solid state acceleration.
- FusionIO card / Sun F20 card (will the FusionIO card work in the Sun box?
- DAS shelf (something like this http://www.broadberry.co.uk/das-direct-attached-storage-servers/cyberstore-224s-das) which a combination of 15k sas disks and some Intel X25-E drives for DB indexes etc) what would I need to put in the x4270 to add a DAS shelf? I think it's a SAS HBA card, do I have to use Sun's own card or will any PCI Express card work?
Anything else??? what would you guys do from your experience?
I appreciate it's a lot of questions, but I haven't expanded a DB machine for a number of years and the landscape has changed dramatically since then! Any advice or feedback would be very much appreciated.
Let me know if there's anything else I can clarify.
Thanks in advance!