Questions tagged [zfs]

ZFS is a modern file system and volume manager originally developed by Sun Microsystems and licensed under the CDDL. It is a copy-on-write file system with support for large storage arrays, protection against corruption, snapshots, clones, compression, deduplication and NFSv4 ACLs. An open-source fork of ZFS can be found at http://open-zfs.org/ , which is supported by ZFSonlinux.org, illumos.org and ZFS developers in the FreeBSD & Mac OS X communities.

11
votes
8answers
9k views

Cannot destroy ZFS snapshot: dataset already exists

I have a server (T5220, though I doubt it matters) running Solaris 10 8/07 and I have a ZFS pool, "mysql", on internal disk. Within it I have a filesystem "mysql/data/4.1.12", which I snapshot hourly ...
2
votes
1answer
39 views

Can I encrypt a whole pool with ZFSoL 0.8.1?

I have compiled ZFS 0.8.1 for my server, and it is running fine. I am also able to create encrypted filesystems like mypool/myencfs. However, mypool is also a filesystem, and it seems that I cannot ...
4
votes
2answers
1k views

ZFS Shares not exported until sharenfs property re-set on Ubuntu 16.04

I am setting up ZFS and NFS on Ubuntu Server 16.04LTS and have a weird issue that is causing me to go crazy. I have set up ZFS and NFS using ZFS shares as described in https://pthree.org/2012/12/31/...
3
votes
1answer
2k views

ZFS copy on write

I am planning to use ZFS for backups. 5-10 servers will "stream" updates via DRBD to very large files (500 gigabytes each) on ZFS file system. The servers will generate about 20 megabytes per ...
0
votes
0answers
8 views

2 hba controllers plugged, but only 1 detected

I have 2 hba controllers (lsi 9211-8i). Recently both on them have been individually flashed to it mode (also made sure to assign different sas addresses to each one). On it's own each card looks to ...
2
votes
0answers
21 views

iSCSI Multipath to block device on zfs pool in ubuntu

I have succesfuly set up zfs pool, created block on it , and created iscsi target. The target is visible from esx host and i can us it as datastore. steps i did: zpool create tank raidz2 sdb sdc ...
6
votes
1answer
70 views

Storage Setup for iSCSI/NFS servers

We are preparing to replace our storage servers (iSCSI+NFS). The current servers are Debian Wheezy using mdadm+lvm2 for storage, and failover using drbd and heartbeat (never got heartbeat to work). ...
2
votes
1answer
50 views

zfs remove device from a raid

I had a raid5 setup of three disks working up until a couple days ago, when a SATA cable acted up and left the pool on a degraded state. The disk is there, it's fine now but the system refuses to use ...
5
votes
1answer
1k views

ZFS on Centos - “No such pool or dataset” and “devices is currently unavailable”

I'm trying to create zpools on CentOS 7 (3.10.0-327.10.1), and the zpool command seems to hate "wwn-0x" IDs. "zpool status" is clear - there are no zpools currently configured on the machine. I have ...
3
votes
0answers
38 views

ZFS L2ARC at no expense [closed]

I recently upgraded my workstation's SSDs, so now I have 2x256GB SSDs laying around. I am considering to use them as L2ARC disks on my NAS. However my NAS has only 12GB of RAM and 8TB worth of disk ...
1
vote
0answers
55 views

Slow sequential reading in large zfs pool

We are running a zfs pool as temporary storage for scientific data with 24 10TB disks in 4 vdev, each consisting of 6 disks in raidz2 config (recordsize 128K). ~ # zpool status pool: tank state: ...
2
votes
1answer
24 views

ZFS auto-import using cache file failing

One of my systems has recently had its data-disks recreated on a new pool. However, after a reboot the system hangs on trying to import pools from the cache file. I'm puzzled by this, since I ...
3
votes
2answers
1k views

Convert raidz1 to raidz2 via a temporary drive

I set up a new NAS server a few months ago and set it as RaidZ. I'm re-thinking that decision and would like to grab an extra drive and move to RaidZ2. Before everyone replies that this isn't possible ...
1
vote
1answer
35 views

How to get verbose information from `zfs get`

Running Ubuntu 14... "14.04.5 LTS, Trusty Tahr" ...with Ubuntu zfs... libzfs2/trusty,now 0.6.5.11-1~trusty amd64 [installed,automatic] mountall/trusty,now 2.53-zfs1 amd64 [installed,upgradable to: ...
9
votes
4answers
7k views

ZFS: Removing files from snapshots?

Say I have a dataset with 100 snapshots and want to rm -rf all folders named "cache" in all snapshots. I want to actually free up the space, not just hide it away in layers of snapshots, so making a ...
4
votes
2answers
730 views

ZFS: Is there a way to find out where the blocks for a file are stored?

Is there a way in zfs to find out where blocks for a particular file are stored? I'd like to be able to ask for the locations of all the blocks for a file, including ditto blocks. (Yes, I understand ...
2
votes
1answer
1k views

Replaced storage controller, now can't find ESXi ZFS mount point

We have an older file server (running Gentoo of all things) that recently suffered a storage controller failure. The parts were replaced and everything is back online except one item, probably the ...
1
vote
1answer
64 views

Linux /proc/sys/vm/drop_caches in guest VMs

Question: Would it ever be a good idea to disable page cache inside guest VM's and instead rely on the ZFS ARC (and SSD based L2ARC) of the host? Context: I'm asking since I'm running a Proxmox ...
8
votes
6answers
17k views

Identify Disks on SuperMicro server running FreeBSD

I am running on a SuperMicro 2U server with 6 disks in a ZPool. I want to identify each drive bay using the Drive Carrier LED from running a command from a tool in FreeBSD. Is there a way to do this? ...
0
votes
0answers
17 views

Replication task not writing data?

I configured two replication tasks on a FreeNas 11.2 server, one points to data/db (80mb) and the other to data/images (1000s of files, ~1Tb approx). Both tasks are working properly, I can see on the ...
1
vote
1answer
48 views

How do ZFS snapshots work and how would I implement a retention policy similar to OpenSolaris'?

I've been using ZFS for a while and have snapshots piling up. I believe I can start deleting the old snapshots, but want to be doubly sure. A ZFS snapshot would be essentially similar to a git tag ...
4
votes
1answer
714 views

What is the correct option for Samba's “strict allocate” when serving a zfs volume?

What is the correct option for Samba's "strict allocate" when serving a zfs volume? The documentation says: This is a boolean that controls the handling of disk space allocation in the server. ...
3
votes
1answer
926 views

How to change GELI passphrase on FreeBSD 11 Root-On-ZFS system with mirror RAID?

How to change GELI passphrase on FreeBSD 11 Root-On-ZFS system with mirror RAID? Swap devices are also mirrored and ancrypted. I have /dev/ada0p5.eli /dev/ada1p5.eli and /dev/mirror/swap.eli devices....
4
votes
1answer
2k views

ZFS ARC size vs target size

I am trying to understand the inner workings of the ZFS ARC. However, I am confused with several things: actual (zfs:0:arcstats:size) vs target size (zfs:0:arcstats:c). I understand that actual size ...
0
votes
1answer
955 views

install grub in a usb and boot proxmox from another drive

Good morning my friends! I'm tryng a solution before buy some new hardware. So this is my situation: I have some beautifull hp dl360p gen8 that comes with an p420i hardware raid controller. What ...
1
vote
1answer
39 views

Bandwidth and IO issues when running hardware raid and zfs

I've inherited a setup using Linux Ubuntu 14, a megaraid_sas, and ZFS. We're getting some performance problems (never being able to fully utilize the 6GB bandwidth from the raid) and I'm curious if ...
2
votes
1answer
45 views

ZFS pool has one drive mounted twice

My ZFS array is best summed up like this: # zpool status pool: sbn state: ONLINE scan: scrub repaired 8K in 44h43m with 0 errors on Mon Feb 11 21:07:56 2019 config: NAME STATE ...
2
votes
1answer
182 views

How can I recover my ZFS pool, which suddenly went offline and reports that it was “last used by another system”?

tl;dr: I am running a FreeBSD 11.2 NAS server with ZFS on a server with 16GB ECC memory. I've discovered that my main pool has disappeared. ZFS can see the pool, but reports fault ZFS-8000-EY and ...
2
votes
1answer
181 views

ZFS Send and ZFS receive dataset without -RI incremental replication sync

Is there a way I can send ONLY the latest snapshots to the backup zfs system even though it has previous snapshots? When I try I keep getting error: "cannot receive new filesystem stream: ...
1
vote
1answer
38 views

Diagnosize ZFS cache needs

I have a peculiar load on a machine that is limited by disk IO, mostly reads. The bulk of the IO happens on slow network attached disk that are formated with ZFS. Using iostat I can clearly see that ...
1
vote
1answer
106 views

Can FreeNAS zfs send to a Linux machine?

I have a FreeNAS 11.2 box. I'd like to use zfs send to send snapshots to another box. Can that receiving box be a Linux machine or does it need to be FreeBSD? What if the FS is encrypted using ...
2
votes
1answer
2k views

How do I upgrade and keep my ZFS pools on Ubuntu Server?

I have a server running the 4-year-old Ubuntu 12.04 LTS with zfsonlinux installed on the machine with a 1.5TB mirrored drive setup. The Ubuntu 16.04 LTS has no upgrade path, so I'll have to reimage ...
5
votes
2answers
275 views

At my wits end. What could cause my server to randomly hard reset? (Seems to be related to ZFS)

I have a server that I built years ago that has worked like a champ. But within the past few months it has started to become seriously unstable with no discernible pattern. I have been debugging it ...
7
votes
2answers
10k views

zpool import: volume FAULTED with corrupted data, is it possible to save some data?

I was using Freenas 8.2 and decided to upgrade to 9.2. All seem to go well, upgraded zfs to 28 and rebooted. During next boot it seem to take forever and at some point I decided to turn off the ...
2
votes
3answers
420 views

Can I use ZFS to replicate (fast) EC2 instance store to (slow) EBS store?

I love the idea of using SSD EBS instance stores as L2ARC and ZIL for a zpool backed by EBS. Going further (and into more dangerous territory), could I instead create a zpool mirror with the 2 ...
5
votes
2answers
26k views

FreeNAS, Do I need 1GB per TB of usable storage, or 1GB of memory per TB of physical disc?

The title says it all. When setting up free NAS, do I need 1GB per TB of usable storage, or 1GB of memory per TB of physical disc?
0
votes
1answer
2k views

GPT partition errors on boot - ZFS FreeBSD

My system appears to be running fine and I'm just trying to clean up errors. That said... On boot, I get the following errors for all drives in a 24 disk storage enclosure: GEOM: diskid/DISK-%20%20%...
180
votes
2answers
40k views

What are the different widely used RAID levels and when should I consider them?

This is a Canonical Question about RAID levels. What are: the RAID levels typically used (including the RAID-Z family)? deployments are they commonly found in? benefits and pitfalls of each?
2
votes
1answer
363 views

mpt3sas_scsih_issue_tm: timeout when doing ZFS scrub

Overview We are currently doing a scrub on a ZFS pool with 12 RAID-Z1 vdevs, and each vdev has 12 drives. Each vdev corresponds to an enclosure. The hardware is a Dell PowerEdge 730xd with two Dell ...
20
votes
4answers
2k views

If a RAID5 system experiences a URE during rebuild, is all the data lost?

I understand the argument regarding larger drives' increased likelihood of experiencing a URE during a rebuild, however I'm not sure what the actual implications are for this. This answer says that ...
5
votes
2answers
1k views

How to make RAID controller rescan devices

I have the following setup: A single server with two LSI MegaRAID SAS 9380-8e controllers which are both connected to two 60-bay disk shelves while roughly following the design by Edmund White (see ...
5
votes
1answer
148 views

Resize zfs pool

We are using Digital Oceans block storage feature on our FreeBSD system. When we add a new block storage we get: da0 at vtscsi0 bus 0 scbus0 target 0 lun 1 da0: <DO Volume 1.5.> Fixed Direct ...
2
votes
1answer
68 views

ZFS on iSCSI devices (with Encryption?) [closed]

I own an old NAS (Buffalo TeraStation Pro II) with four 500GB Samsung HD502IJ SATA drives. On the NAS i installed Debian 9. The NAS is pretty old and consumes a lot of engergy already without any ...
4
votes
1answer
115 views

HP D2700 configuration

I have a HP D2700 connected to a dl360G7 with a p812 controller using one SAS cable. The storage enclosure houses 23 SAS 450GB disks with one spare for a raid6 array. It serves as an nfs datastore for ...
5
votes
2answers
480 views

zdb doesn’t recognize my pool?

On my freenas server, zpool status tells me I have 2 zfs pool : data & freenas-boot : % zpool status pool: data state: ONLINE scan: scrub repaired 0 in 0 days 04:16:16 with 0 errors on Mon ...
26
votes
2answers
7k views

ZFS Data Loss Scenarios

I'm looking toward building a largish ZFS Pool (150TB+), and I'd like to hear people experiences about data loss scenarios due to failed hardware, in particular, distinguishing between instances where ...
2
votes
3answers
1k views

Scale-out distributed storage with snapshots

I'm aware there are many similar questions around, several with great answers. I still haven't quite found what I'm looking for though: a distributed, scale-out FS that supports snapshots. Gluster ...
4
votes
1answer
1k views

solaris zfs won't import pools from another system after a system crash

attempted to import a couple zfs pools from another solaris 11.1 box that crashed hard. the log device went corrupt but the disks are fine. there weren't any writes to the system (it sits idle) so i'...
2
votes
1answer
458 views

Recover ZFS data

Context/Hardware: HP microserver gen8 1x1TB - standalone, 2x4TB Raid 1x16GB iLO SDCARD with Debian + OpenMediaVault Event: SDCARD failure restarted server and installed Ubuntu on 1TB drive ...
2
votes
2answers
212 views

ZFS protection against bit rot and silent corruption without RAID

I have never encountered a disk failure in my whole life but I had a dozen of bit rot and silent corruptions. 'Normal' file systems and hardware RAID can do absolutely nothing about it. I have been ...