Right now I have a FreeBSD hosts with ZFS and NFSv4. It is replicated to another FreeBSD box for backup purposes.
The ZFS features that are important to me are
- software RAID6
- snapshots, or some other way of replication to another host
- replace a failed disk without taking the host offline
Could the same or similar setup be done with XFS or GlusterFS on CentOS 6?
The hardware is
- Supermicro CSE-847E16-R1400LPB chassis, 36 HS bays
- Supermicro H8DG6-F AMD Dual G34 mainboard
- AMD Opteron 6320, 2.8GHz 8-core, 8MB L2 cache, 6400MT
- 64GB ram, and 128GB swap
Each host have 36*3TB space in RAIDZ2, so 100TB usable and 50TB used.
It seams that it is the Ubuntu clients that can crash the host on heavy reads. For now there are ~5 NFS clients. No read caching.
No NFSv4 tuning besides enabling Jumbo Frames
echo 'kern.ipc.nmbclusters="32768"' >> /boot/loader.conf echo 'kern.ipc.maxsockbuf=16777216' >> /etc/sysctl.conf echo 'net.inet.tcp.sendspace=262144' >> /etc/sysctl.conf echo 'net.inet.tcp.recvspace=262144' >> /etc/sysctl.conf echo 'net.inet.tcp.rfc1323=1' >> /etc/sysctl.conf echo 'net.inet.tcp.sendbuf_max=16777216' >> /etc/sysctl.conf echo 'net.inet.tcp.recvbuf_max=16777216' >> /etc/sysctl.conf