Take the 2-minute tour ×
Server Fault is a question and answer site for professional system and network administrators. It's 100% free, no registration required.

I would like to know if it is possible to use the FC-switch (that is used for a SAN) also for TCP/IP traffic.

We have servers (virtual machines) that must have a fast network for copying much data. It would be better to use the existing FC network than a slower 1 Gb network.

Is this possible?

share|improve this question
add comment

4 Answers 4

That is possible. It's called IPFC and RFC 2625 specifies it. You have to have an TCP/IP stack for your HBA. Tell more details, which HBAs and Switches etc.

share|improve this answer
    
excellent and informative answer, I still think he should try to use the vSwitch but you've taught me something today - bravo :) –  Chopper3 Jan 15 '10 at 11:59
    
I just got to deal with a big order of CNA (FCoE) equipment and had to investigate the idea of abusing some FC switches for some serious TCP/IP pain ... –  pfo Jan 15 '10 at 12:02
    
I've been very busy with CNAs (into Cisco Nexus's btw) too - loving it but really wasn't aware of the opposite option. –  Chopper3 Jan 15 '10 at 12:04
    
Yeah, I'm looking into Nexus 4K and 5Ks for some IBM bladecenter stuff. –  pfo Jan 15 '10 at 12:07
    
I'm a HP blade guy and a bit annoyed that they're not doing a 4K interconnect as they're VirtualConnect competes a bit - most of my experience is with 7Ks, not really looked at the 5Ks as much. –  Chopper3 Jan 15 '10 at 12:24
show 2 more comments

Yes, it is possible - QLogic (at least) HBAs support IP over F/C, and many switches also support it. However, if you want to push large amounts of data across it you are in contention for bandwidth with the disks, so you may have to keep an eye on total utilisation.

You may need to get extra licensing for your switch to support IP.

F/C is possibly the most expensive networking technology in widespread use, so unless you are really stuck with it, you are probably better off using something else. If you have standalone servers then 10Gbit Ethernet or Infiniband is probably cheaper for the bandwidth than fibre channel.

If you're using blades then you're pretty much stuck with whatever is supported by the blade chassis. If the HBAs in your blades support IP over F/C then you could use it. See if the chassis can be upgraded to support Infiniband.

share|improve this answer
    
FCoE (fibre channel over ethernet) is also an interesting solution that a lot of people are currently looking into. Seems to me that the parent poster ist quite budget limited and that purchasing new ethernet equipment (would be the easiest) isn't an option -- this probably rules out 10GE/IB. –  pfo Jan 15 '10 at 13:22
    
unless you are careful about how you go about it you can saturate the PCI bus of most machines with a couple of trunked 1Gb network connections anyway. –  JamesRyan Jan 15 '10 at 15:24
    
Exactly, but most servers today provide multiple 4x,8x,16x PCI-E 2.0 connectors which i yet have to see getting saturated (with Gigabit-Ethernet). Keep in mind that a PCI-E 1.0 1x Link is 2GBps (4GBps duplex), with 2.0 its 4GBps (8GBps duplex) and 3.0 is 8GBps (16GBps duplex). PCI-E is a switched fabric - just put those 8x LACP trunks on different PCI-E slots and everything's gonna be fine. –  pfo Jan 15 '10 at 18:42
add comment

Edit - I stand corrected, well spotted pfo.

No, you can transit FC traffic over IP (FCIP) but not the other way around sorry.

Can you not just force the specific VMs onto the same host, nothing's as quick as a vSwitch.

share|improve this answer
    
This is true if there is only one hypervisor or when there is a connection between two VM's in the same hypervisor. –  user28362 Jan 15 '10 at 13:24
add comment

It's possible, but these are the requirements:

  • HBAs that support it (boils down to drivers and firmware)
  • FC Switch that supports it
  • Operating systems that support it (Solaris supposedly supports IPoFC for every adapter I'm told)

I'd give'r a try either way.

I'm pulling my knowledge from here (great read): http://noteablecomputers.com/ipfc.txt

share|improve this answer
add comment

Your Answer

 
discard

By posting your answer, you agree to the privacy policy and terms of service.

Not the answer you're looking for? Browse other questions tagged or ask your own question.