4

So, I'm getting a bit confused here. I have a Dell MD3200 SAN with dual controllers. Each controller has an Ethernet management port that connects to a switch. Together the two controllers connect to independent switches for redundancy.

I'm building out my failover cluster and was told that I should have the SAN management port running over the same subnet, which will isolated to a VLAN. If I just leave it at that, it makes sense, however, if I want to manage the SAN out-of-band through the network on a server that's not on the subnet/VLAN, I won't be able to.

So, the question is, if I have a 10.0.1.X subnet for my servers and a 10.0.2.X subnet for the failover cluster do I make the SAN a part of 10.0.1.X or 10.0.2.X? I personally think I should leave it on 10.0.1.X, but I figure I'd ask just in case.

UPDATE

Just to give you more info, the servers in question are Dell R710s (x2) with x8 1GbE ports. The switches are Dell 6224s (x2). I was planning on the servers having 3 teamed connections. 2 ports on a "Public" team, 2 ports on a "Private" team (for the cluster) and 4 ports for the "Virtual Machines" team.

The SAN is an MD3200, not the MD3200i. It connects to the servers with SAS via redundant HBA cables.

The cluster is going to be a Windows Server 2008 R2 Failover Cluster for Hyper-V.

Improve this question

3 Answers 3

Reset to default
4

The MD3200 connects to servers via SAS; so I'm thinking you mean the MD3200i. It's "normal" to separate vLANs for management, iSCSI, and client traffic. You don't mention what kind of cluster software you're running, but for most it's pretty common for it's cluster/heartbeat traffic to have it's own vLAN.

Depending on your server and hardware each of these may have their own physical NICs or may be shared. Also normal to have a minimum of 4 NIC ports for 1GbE; or 2 ports of 10GbE/FC/IB/NCA and 2 ports of 1GbE. It's also normal to have a L4 switch or router with access controls that allows all of these vLANs to be routed (selectively and where applicable).

Breaking that down:

  • Your servers should have at least 4 network ports.
    • Depending on your setup you may want 6 or even 8; it really depends.
  • You should have vLANs for:
    • Management (ESX or Hyper-V Hypervisor; iLO/DRAC/iLOM/etc; SAN Management)
    • SAN Traffic (whatever it is: iSCSI, FC, IB, SAS; it should be separate)
    • Client Traffic (your normal traffic, sometimes you'll want more than one, as many as you would have without any of the extra complexity)
    • Clustering/Heartbeat (optional, depending on the software you're using). I run Hyper-V clusters and have heartbeat on the management network, it's not terribly sensitive to minor lag; some cluster software is painfully sensitive to lag and needs to be on its own.
  • Each vLAN should have it's own subnet. I would highly recommend using subnets larger than /24 or spacing them out so it's easy to expand them later (I wouldn't recommend anything smaller than /20; ie. 10.0.0.0/20, 10.0.16.0/20, 10.0.32.0/20, etc). There should be some form of routing between subnets. High end switches have this feature, your firewall may as well. if you're lacking a box or VM with pfSense works great.

Other thoughts: The NIC chips really matters. Make sure your servers have something good and Google for cluster or SAN problems with the particular chip. I run Broadcom BCM5709 chips for instance (all my servers use the exact same chip). These chips had problems with past firmware that has been resolved. Intel chips tend to be very good. In any case check it out and be sure to run the latest firmware, drivers, and management software.

Improve this answer
5
  • Well, yes, it does connect to the servers via SAS, but the controllers also have an Ethernet management port. It's not the 3200i, not running over iSCSI. The servers are Dell R710s (x2) with x8 1GbE ports. The switches are Dell 6224s (x2). I'll update my question with more info on the setup.
    – Gup3rSuR4c
    Feb 28, 2012 at 20:51
  • All of my NICs are running Broadcom BCM5709C NetXtreme II chips. Gonna have to check the firmware on them. Side note, the teaming software is so sloppy...
    – Gup3rSuR4c
    Feb 28, 2012 at 21:03
  • 1
    In a "Best Practices" configuration, the server interfaces that Clients/Users never need to access should be on their own vLAN. This usually includes SAN management, iLO/DRAC/iLOM, and VM Hosts. In particularly large installations you'll commonly see more than one management vLAN and Infrastructure vLANs for various separation of administrative services. In very small deployments it's not uncommon for everything to just be on a single broadcast domain. It just depends on the network.
    – Chris S
    Feb 28, 2012 at 21:03
  • I'm not sure about the Dell branded 5709 NICs, but Broadcom's BACS utility may be able to configure them: broadcom.com/support/ethernet_nic/netxtremeii.php Might be the same utility you're looking at now too...
    – Chris S
    Feb 28, 2012 at 21:06
  • It is, I've got BACS3 running on the servers.
    – Gup3rSuR4c
    Feb 28, 2012 at 21:09
1

Generally you should have two independent vlans, one for each iscsi network. The management interface generally should sit along side your servers or in your general administration vlan depending on setup.

Improve this answer
3
  • That's what I was thinking it should be, but was told otherwise by a friend who already has a live setup of what I'm trying to do. I have a feeling his is wrong now...
    – Gup3rSuR4c
    Feb 28, 2012 at 20:57
  • you are not using isci correct its just sas hba's or did I miss something
    – tony roth
    Feb 28, 2012 at 23:59
  • @tonyroth, Yes, that's correct.
    – Gup3rSuR4c
    Feb 29, 2012 at 4:00
0

Your question boils down to how important your management interface is. If you've suffered some sort of network failure, you can still use your SAN while the management ports are unavailable. You simply can't change it by accessing the management port. While it's not ideal, you always have the ability to get in via serial or crossover in an emergency.

"Failover cluster" means different things to different people. If you need a heartbeat between the two storage controllers, then they need to be able to ping each other. If it's just a standby device kept in synch to be used in case of disaster, then you could put it on its own subnet, vlan, or even network. Just so long as the replication traffic (which I'll assume is IP) can be routed there.

Improve this answer

You must log in to answer this question.

Not the answer you're looking for? Browse other questions tagged .