ZFS is a modern filesystem originally developed by Sun Microsystems and licensed under the CDDL. An open-source fork of ZFS can be found at http://open-zfs.org/ , which is supported by ZFSonlinux.org, illumos.org and ZFS developers in the FreeBSD & MacOSX communities.

learn more… | top users | synonyms

108
votes
2answers
15k views

What are the different widely used RAID levels and when should I consider them?

This is a Canonical Question about RAID levels. What are: the RAID levels typically used (including the RAID-Z family)? deployments are they commonly found in? benefits and pitfalls of each? ...
16
votes
1answer
8k views

Hosting a ZFS server as a virtual guest

I'm still new to ZFS. I've been using Nexenta but I'm thinking of switching to OpenIndiana or Solaris 11 Express. Right now, I'm at a point of considering virtualizing the ZFS server as a guest within ...
1
vote
2answers
2k views

My OpenSolaris Server hangs when writing large files after upgrading zpool

yesterday I added new harddrives(four as a raidz1 and one as hot-spare) to a opensolaris server, after extending the zpool the server hangs when writing large files but not when reading large ...
12
votes
5answers
3k views

ZFS best practices with hardware RAID

If one happens to have some server-grade hardware at ones disposal, is it ever advisable to run ZFS on top of a hardware-based RAID1 or some such? Should one turn off the hardware-based RAID, and run ...
7
votes
2answers
2k views

ZFS - destroying deduplicated zvol or data set stalls the server. How to recover?

I'm using Nexentastor on a secondary storage server running on an HP ProLiant DL180 G6 with 12 Midline (7200 RPM) SAS drives. The system has an E5620 CPU and 8GB RAM. There is no ZIL or L2ARC device. ...
4
votes
4answers
16k views

Disabling RAID feature on HP Smart Array P400

I'm planning to use ZFS on my system (HP ML370 G5, Smart Array P400, 8 SAS disk). I want ZFS to manage all disks individually, so it can utilize better scheduling (i.e. I want to use software RAID ...
18
votes
2answers
3k views

ZFS Data Loss Scenarios

I'm looking toward building a largish ZFS Pool (150TB+), and I'd like to hear people experiences about data loss scenarios due to failed hardware, in particular, distinguishing between instances where ...
9
votes
5answers
5k views

Best filesystem choices for NFS storing VMware disk images

Currently we use an iSCSI SAN as storage for several VMware ESXi servers. I am investigating the use of an NFS target on a Linux server for additional virtual machines. I am also open to the idea of ...
9
votes
2answers
1k views

ZFS: How do you restore the correct number of copies after losing a drive?

With zfs, if you have copies=2 and then you lose a drive containing some of those copies, how do you tell the system that it should make a new copy of the data blocks for the affected files? Or does ...
9
votes
2answers
13k views

ZFS: Mirror vs. RAID-Z

I'm planning on building a file server using OpenSolaris and ZFS that will provide two primary services - be an iSCSI target for XenServer virtual machines & be a general home file server. The ...
13
votes
2answers
21k views

How can I add one disk to an existing raidz zpool?

I have an OpenSolaris server with a zpool backupz comprised of four SCSI drives: -bash-3.2# zpool status backupz pool: backupz state: ONLINE scrub: none requested config: NAME ...
10
votes
3answers
4k views

ZFS - Impact of L2ARC cache device failure (Nexenta)

I have an HP ProLiant DL380 G7 server running as a NexentaStor storage unit. The server has 36GB RAM, 2 LSI 9211-8i SAS controllers (no SAS expanders), 2 SAS system drives, 12 SAS data drives, a ...
10
votes
1answer
4k views

Is calculating IOPS for ZFS RAIDZ different then calculating IOPS for RAID5 & RAID6?

When calculating IOPS for traditional RAID arrays, one could use the following formula (Borrowed from Getting The Hang Of IOPS v1.3 on Symantec Connect): Ieffective = (n * Isingle) / (READ% + (F * ...
1
vote
2answers
2k views

Transparent compression filesystem in conjunction with ext4

I am trying to test a project that needs compressed storage with use of the ext4 file system since the application I use relies on ext4 features. Are there any production/stable solutions out there ...
11
votes
1answer
631 views

Why did rebooting cause one side of my ZFS mirror to become UNAVAIL?

I just recently migrated a bulk data storage pool (ZFS On Linux 0.6.2, Debian Wheezy) from a single-device vdev configuration to a two-way mirror vdev configuration. The previous pool configuration ...
1
vote
3answers
2k views

Solaris: detect hotswap SATA disk insert

What's the method used on Solaris to get the system to rescan for new disks that have been hot-plugged on a SATA controller? I've got an HP X1600 NAS which had 9 drives configred in a ZFS pool. I've ...
6
votes
2answers
4k views

What's in my ZFS ARC and L2ARC caches?

I have a simple ZFS setup at home, four disks mirrored, 8GB ram and 120GB Intel X25-M SSD for L2ARC. I ran zpool add poolname cache cXtXdX then generated load and eagerly tracked the warming process ...
4
votes
1answer
3k views

ZFS (NexentaStor) and 4k Advanced Format Partition Alignment

I have a storage system that contains 8 x 1TB drives that use the 4k sector size "Advanced Format". I'm planning to run NexentaStor on this hardware and want to ensure that I'm taking the 4k sector ...
3
votes
4answers
7k views

ZFS - how to partition SSD for ZIL or L2ARC use?

I'm working with a Sun x4540 unit with two pools and newly-installed ZIL (OCZ Vertex 2 Pro) and L2ARC (Intel X25-M) devices. Since I need to keep these two pools in the near-term, I'd like to know how ...
8
votes
4answers
3k views

Can I trust that ZFS is consistent between Linux and FreeBSD?

I'm planning to build a FreeNAS box sometime soon, but if ZFS on Linux eventually proves to be reliable, I might want to switch, just to have a more familiar OS. So I'm wondering if I can trust that ...
5
votes
2answers
4k views

Need to replace disk in zpool … confused

I need to replace a bad disk in a zpool on FreeNAS. zpool status shows pool: raid-5x3 state: ONLINE scrub: scrub completed after 15h52m with 0 errors on Sun Mar 30 13:52:46 2014 config: ...
3
votes
6answers
5k views

MegaRAID JBOD substitute

It seems that certain MegaRAID chips don't support JBOD (unfortunately). I've read online that to make these controllers act as a pass-through, I should configure the disks in RAID0. What RAID0 ...
6
votes
1answer
1k views

Does ZFS replace the need for hardware/software RAID?

I want to provide protection against data loss on my servers. Typically, I'd use hardware RAID 1 or 5, but I've been reading up on ZFS. Is it correct that ZFS itself provides RAID 1 or 5 like data ...
4
votes
1answer
2k views

ZFS on Linux/Ubuntu: Help importing a zpool after Ubuntu upgrade from 13.04 to 13.10, device IDs have changed

I have updated Ubuntu from version 13.04 to version 13.10, only to discover that the SATA disks IDs have changed, and my ZFS pool now fails. On new Ubuntu 13.10 the disk IDs are now ata-* instead of ...
2
votes
3answers
200 views

Installing a modest ZFS system, ZFS for the boot disk

I work at a repair shop and I'm thinking of building a Solaris Express, or maybe using whatever the open version is called nowadays, ZFS based NAS out of the mountains of old pieces of hardware we've ...
0
votes
2answers
885 views

Debug Nexenta/OpenSolaris core files?

I have a Sun x4540 that was recently converted to NexentaStor Enterprise Edition from an earlier OpenSolaris. The system disks were wiped and the zpools were exported and reimported. I'm hosting ...
34
votes
12answers
24k views

ZFS vs XFS

We're considering building a ~16TB storage server. At the moment, we're considering both ZFS and XFS as filesystem. What are the advantages, disadvantages? What do we have to look for? Is there a ...
25
votes
1answer
2k views

ZFS endless resilvering

I have a large (> 100TB) ZFS (FUSE) pool on Debian that lost two drives. As the drives failed, I replaced them with spares until I could schedule an outage and physically replace the bad disks. When ...
7
votes
6answers
3k views

hardware recommendations for a DIY storage system based on ZFS [closed]

Looking to make use of old server lying idle as a proof-of-concept ...here are specs Dell PE 2900: Xeon 5110 - 2P, 12 GB RAM, 8x 300 GB 15K drives, Perc 5i+256 MB cache what additional h/w would be ...
9
votes
2answers
6k views

How to upgrade a ZFS RAID-Z array to larger disks on OpenSolaris?

I'm planning on installing OpenSolaris on my home server (right now it has Linux) and I would like to know how to prepare for upgrading the server to have larger hard drives in the future. Now the ...
21
votes
4answers
4k views

LVM snapshots vs. file system snapshots

As far as I know, LVM makes it possible to take snapshots of a volume. There are also a number of file systems (ZFS, Btrfs, reiserfs, ...) which supports snapshots. However, I've never understood the ...
7
votes
2answers
5k views

KVM on Illumos (OpenIndiana vs. SmartOS)

I'm considering virtualizing a number of guests onto a single server running a recent port of KVM to Illumos. It sounds like my two primary options will be OpenIndiana and SmartOS. The distribution ...
14
votes
6answers
9k views

Is bit rot on hard drives a real problem? What can be done about it?

A friend is talking with me about the problem of bit rot - bits on drives randomly flipping, corrupting data. Incredibly rare, but with enough time it could be a problem, and it's impossible to ...
8
votes
5answers
10k views

ZFS Sync over unreliable, slow WAN. ZFS replication, or rsync?

I've been tasked with making an off-site backup work over the WAN. Both storage boxes are FreeBSD based NAS boxes running ZFS. Once or twice a week, 15-60 gigs of photography data gets dumped to the ...
6
votes
3answers
3k views

Where can I find introductory documentation for ZFS?

I recently installed OpenIndiana because of an interest in ZFS. I like the feature-list of ZFS, but I'm having a hard time wrapping my head around how to configure it. All of the documentation I ...
6
votes
1answer
2k views

Is there a tool for managing FreeBSD jails that knows about ZFS?

ZFS under FreeBSD lets one assign filesystems to a jail, such that an account in the jail with the appropriate privileges can access the filesystem, create new subordinate filesystems, and so forth. ...
13
votes
3answers
2k views

150 TB and growing, but how to grow?

My group currently has two largish storage servers, both NAS running debian linux. The first is an all-in-one 24-disk (SATA) server that is several years old. We have two hardware RAIDS set up on it ...
3
votes
2answers
1k views

ZFS: best practices for adding cache to pools

sounds like dumb question but there are no ready answers at SF can the cache pool have different name than the zpool? eg: suppose there is a zpool "tank" serving NFS and iSCSI can a new cache pool ...
6
votes
4answers
1k views

ZFS on top of Hardware Mirroring, or just mirror in ZFS?

I have an IBM x346 with dual 3.2Ghz Xeons and 2x36GB 15k SCSI disks. I'm running an entirely ZFS-based install of FreeBSD 8.1. I can configure the bios to mirror the two disks, and then put ZFS on ...
3
votes
6answers
7k views

NexentaStor CE or Openfiler? Which do you recommend? [closed]

I'm planning to implement a 'poor man's storage' using Openfiler or NexentaStor CE. I need the filer solution to provide iSCSI target and CIFS sharing abilities. The iSCSI target and CIFS share will ...
10
votes
1answer
2k views

How large is my ZFS dedupe table at the moment?

I have read a lot of information about planning RAM requirements forZFS deduplication. I've just upgraded my file server's RAM to support some very limited dedupe on ZFS zvols which I cannot use ...
9
votes
8answers
4k views

Anybody have experience with using Nexenta? [closed]

I'm evaluating the Nexenta platform to hopefully one day replace our legacy file servers. I would primarily use it as a CIFS server in an Active Directory environment. Anyone out there have any ...
7
votes
5answers
2k views

File size with zfs compression

I usually estimate the size of a whole directory tree using du -ks $DIRECTOY_TREE_ROOT, but this method cannot be used when zfs compression is on. The total displayed by ls -l is ok for a single ...
6
votes
3answers
5k views

Is a large RAID-Z array just as bad as a large RAID-5 array?

For a long time I've heard about how bad an idea a large (>5TB?) RAID-5 array is simply because there's a high risk for another drive to fail. Has RAID-Z1 managed to remedy this for an array of any ...
4
votes
1answer
180 views

ZFS: will RAM shortage cause trouble?

what can happen if i've not enough RAM with a ZFS with dedup option activated?
4
votes
4answers
3k views

How to determine which disk failed in a FreeNAS / ZFS setup

I'm building out a FreeNAS based server in a Supermicro X6DHE-XB 3U enclosure with 4G of RAM, 16 SATA hot-swap bays. It comes with 2x8 port 3Ware RAID cards, but I'm planning on just using the ZFS ...
3
votes
2answers
9k views

grow/shrink a zfs RAIDZ

I'm going to build a freenas server, would like to make sure what I can do with such magical and advanced zfs. If I have 5 * 3TB disks in RAIDZ (12TB storage in total), now I am trying to add another ...
2
votes
2answers
3k views

FreeNAS confusion: not sure what happened. raidz1 “DEGRADED”, disk “FAULTED”

Sorry for the long narrative, but I'm thoroughly confused. I'm using FreeNAS-8.0.4-RELEASE-p2-x64 (11367) on a box with 5x3TB SATA disks configured as a raidz volume. A few days ago, the console ...
2
votes
2answers
2k views

Why does doing large deletes, copies, moves on my ZFS NAS block all other IOs?

I've got a Solaris 11 ZFS-based NAS device with 12x1TB 7.2k rpm SATA drives in a mirrored configuration. It provides 2 services from the same pool - an NFS server for a small VM farm and a CIFS ...
2
votes
1answer
838 views

ZFS file deletion and its relationship to disk space

I deleted a large file (many gigs) from a Solaris system and it didn't seem to recover the amount of space on the zpool equal to the size of the file. Is there any reason that I wouldn't see this ...