Questions tagged [zfs]

ZFS is a modern file system and volume manager originally developed by Sun Microsystems and licensed under the CDDL. It is a copy-on-write file system with support for large storage arrays, protection against corruption, snapshots, clones, compression, deduplication and NFSv4 ACLs. An open-source fork of ZFS can be found at http://open-zfs.org/ , which is supported by ZFSonlinux.org, illumos.org and ZFS developers in the FreeBSD & Mac OS X communities.

Filter by
Sorted by
Tagged with
0
votes
0answers
12 views

Cache configuration for PostgreSQL/TimescaleDB VM on ZFS with proxmox

I have a proxmox cluster of a single node and I want to start a new VM with a PostgreSQL and TimescaleDB and after a lot of reading about how to tune ZFS volumes for this purpose I still have some ...
0
votes
0answers
20 views

znapzend no longer works after upgrade to Ubuntu Server 20.04.1

Ubuntu Server was upgraded from 18.04 LTS to 20.04.1 LTS and subsequently znapzend service fails to start with the reason being: znapzend[3436]: ListUtil.c: loadable library and perl binaries are ...
1
vote
1answer
301 views

Pool gone with upgrade to Ubuntu 20.04

I upgraded my server (SuperMicro X11-SSM-F, LSI SAS 9211-8i) from Ubuntu 18.04 to 20.04. The server had 2 zpools, one composed of a single WD Red 10 TB (downloadpool), and the other composed of 8 WD ...
2
votes
0answers
31 views

What is the easiest way to encrypt an existing ZFS dataset?

I would like to convert a lot of ZFS datasets I have on a (Ubuntu 20.04) server (about 3 TB of data). I've already tested this a bit, and what I've been doing so far is: Create a new encrypted ...
3
votes
1answer
1k views

How to use setfacl on ZFS dataset to set the equivalent of UNIX-style chmod 770?

I'm trying to use setfacl to set the permissions of different ZFS datasets, and I want those ACL permissions equivalent to UNIX-style chmod 770. What setfacl command could accomplish this, and what ...
4
votes
2answers
1k views

How to change the drive reference in a zfs pool from /dev/sdX to /dev/disk/by-id (ata-XXXXXX)

In the example below, how can the devices in the second mirror be changed so they they reference the /dev/disk/by-id instead of /dev/sdX? user@pc:~$ sudo zpool status pool: storage state: ONLINE ...
2
votes
1answer
1k views

“renaming” a drive in a ZFS pool?

So I'm playing around with ZFS on what will eventually be a file server, and I managed to get myself into this state: pool: storage state: DEGRADED status: One or more devices has experienced an ...
0
votes
0answers
18 views

Null bytes in mail from cron job calling zfSnap

I am using openmediavault 5.5.12-1 (Debian 10.6). I added a cron.d file /etc/cron.d/my-backup: PATH=/usr/local/sbin:/usr/local/bin:/sbin:/bin:/usr/sbin:/usr/bin MAILTO="me@domain.com" 0 0 * ...
1
vote
0answers
20 views

One of my pools disapears after reboot

One of my pools disappears after reboot. I have Debian Buster Root on ZFS and my bpool and rpool pools are OK. root@ZFSTEST:~# zpool status mkpool pool: mkpool state: ONLINE scan: scrub repaired ...
7
votes
3answers
4k views

What does zfs receive -F do?

When I read man zfs for zfs receive I see -F Force a rollback of the file system to the most recent snap- shot before performing the receive operation. If receiving an ...
8
votes
3answers
833 views

Dell R730xd - Best way to configure storage for simultaneous use with ZFS & Hardware RAID

I recently purchased a Dell R730xd that came with an H730 RAID card. I would like to bring an existing 6 disk ZFS pool to this server as well as create an additional 6 disk hardware RAID. Is it ...
11
votes
5answers
10k views

Which is faster for read access on EC2; local drive or EBS?

Which is faster for read access on an EC2 instance; the "local" drive or an attached EBS volume? I have some data that needs to be persisted so have placed this on an EBS volume. I'm using ...
0
votes
1answer
43 views

file shared on SMB on zfs on linux cannot be read over network

The file can be opened locally. I think the problem is related to attributes or permissions somehow, but I do not know how to check them. The files are GoPro videos in a particular directory, and ...
3
votes
2answers
107 views

What is the overhead of ZFS RAIDz1/2 in HPC SSD Environment?

Example hardware / host: Modern 64 Core CPU, 128GB Memory 8 x Micron Pro 15.36TB u.2 SSDs SSDs connected by dedicated Oculink per device (no backplane or PCIe sharing) Ubuntu 20.04 Use case: A ...
1
vote
1answer
34 views

zfs send multiple snapshots

I want send several zfs snapshots to another pool. Source pool "rpool", target pool "dpool" rpool/kvm1380_img 88,6G 1,48T 77,6G - rpool/...
2
votes
4answers
1k views

Scale-out distributed storage with snapshots

I'm aware there are many similar questions around, several with great answers. I still haven't quite found what I'm looking for though: a distributed, scale-out FS that supports snapshots. Gluster ...
5
votes
1answer
1k views

What is the difference between aclinherit and aclmode?

ZFS filesystems can have the aclinherit and aclmode properties set on them to control how inheritable ACL entries interact with object creation and Unix-style permissions operations. Unfortunately, ...
1
vote
1answer
3k views

Why is my RAIDZ2 pool larger than the expected size calculation?

I'm building a RAIDZ2 ZFS system, using Ubuntu 13.10 as a base system, and zfsonlinux's packages, having 6 disks dedicated to the pool data and a couple of SSD partitions to do ZIL log and L2ARC cache....
0
votes
1answer
71 views

Cannot see the right and used space on a ZFS dataset

I have set up a vm with debian buster and ZFS. Initially the machine booted from first hard drive, but added x4 20Gb hd and transfered the system to zfs for testing purposes. It works, so I added some ...
2
votes
2answers
74 views

ZFS data lost after a rollback happening on reboot

Edit1: Unlike what I originally thought when creating this question, it seems that the problem was NOT directly caused by the unplanned power-cycle, but by a mistake I might have done with beadm in ...
4
votes
1answer
1k views

Ubuntu 14.04 blk_update_request I/O error on same sector across all drives with ZFS

I'm running Ubuntu 14.04 with ZOL version v0.6.5.4: root@box ~# dmesg | egrep "SPL|ZFS" [ 34.430404] SPL: Loaded module v0.6.5.4-1~trusty [ 34.475743] ZFS: Loaded module v0.6.5.4-1~trusty, ZFS ...
0
votes
0answers
18 views

Monitor ZFS iostats with collectd

I'm using ZFS on a server with lots of interesting IO, and I already use collectd to collect various interesting metrics. I already know about (and use) the zfs_arc plugin, which gives some of the ...
1
vote
0answers
78 views

zfs, zpool list no pools avaliable, and zpool import no pools available to import

I have a zpool with four disks: /dev/disk/by-id/ata-SAMSUNG_HD103SJ_S246J9AZB03256 /dev/disk/by-id/ata-SAMSUNG_HD103SJ_S2NWJ50BB01630 /dev/disk/by-id/ata-SAMSUNG_HD103UJ_S13PJ90S328545 /dev/disk/by-...
1
vote
1answer
47 views

Does IDs from `ls -l /dev/disk/by-id` output are unique to a disk? - DELL PERC card

Does output from ls -l /dev/disk/by-id can be used as a universal disk identifier? I am currently trying to find a unique identifier that I can use to create a ZFS raidz pool using a unique identifier ...
1
vote
0answers
45 views

Recently my NFS RAID performance has gone from very good to basically unusable

First, thanks for any help anyone is willing to give! I have two ubuntu 20.04 servers with two different software RAIDs on them. One is music and movies (RAID6) and the other is personal docs and ...
7
votes
5answers
4k views

zfs - two pools with nested mountpoints and conflicting mount order

I have a problem with automounting separate pools, that have nested mountpoints. I am using ZfsOnLinux 0.6.2. The siuation currently is as follows: zpool1 ---> /var zpool1/log ---> /var/...
0
votes
0answers
25 views

ZFS entering D-State at random

I am running ZFS on Ubuntu 20.04 LTS ontop of hyper-v. At random, currently every 2-3 days, ZFS gets stuck. Samba is non-responsive, File I/O via smb to the ZFS volume ceases and actions on the shell ...
0
votes
0answers
43 views

How do I recursively list all NFS shares/datasets on OpenIndiana?

Running OpenIndiana 2020. Issuing zfs get sharenfs lists all NFS shares for the most part. But how can I see if any subdirectories have been shared with different properties? Selecting a filesystem ...
2
votes
1answer
34 views

ZFS - Deleting Redundant Snapshots

I have written a cron job to automatically create snapshots of ZFS dataset on an hourly basis for critical files that benefit from active tracking. The drawback of this is that these hourly snapshots ...
1
vote
1answer
3k views

FreeNAS - How do you monitor disk/share usage?

I have a server running FreeNAS. It has a built in RAID card that is currently running 4 disks in RAID 10. I have a LibreNMS server that uses SNMP to monitor all our network, virtual OSes, and ...
0
votes
2answers
2k views

install grub in a usb and boot proxmox from another drive

Good morning my friends! I'm tryng a solution before buy some new hardware. So this is my situation: I have some beautifull hp dl360p gen8 that comes with an p420i hardware raid controller. What ...
0
votes
1answer
33 views

ZFS - is it safe to remove files served by ZFS during a resilver/rebuild?

I have a Nexenta ZFS system serving a large NFS volume (using ~85% of 250 TB). One of the 70 disks failed over a week ago, and the system is resilvering a hot spare without issues (other than the ...
0
votes
0answers
20 views

Missing vdev in zpool?

I hadn't touched my home storage server for a year or two. I don't 100% remember what I did at the time. Now looking to expand. I remember that I added a second, 2 device mirror vdev to the zpool, but ...
1
vote
2answers
41 views

zfs is mounted after mongod starts: how do I set the boot order?

Fairly simple problem, I think, but I can't seem to get my head around a fix. I'm on Ubuntu 18.04.3 and mounting zfs volumes with mongo-data at boot correctly with the config below in /etc/systemd/...
6
votes
3answers
253 views

ZFS Equivalent of lvdisplay snap_percent

I've been using LVM snapshots for backing up MySQL databases. FLUSH TABLES WITH READ LOCK is issued and then lvcreate --snapshot --size 4G etc. Because the database is live while the snapshot is ...
1
vote
1answer
39 views

How can I monitor the reliability of connections to network shares?

I can use any of Windows Pro or Server Standard, or CentOS to do this monitoring (I guess). It seems there are some complex issues going on with AWS Deadline jobs which I don't expect anyone to know ...
3
votes
2answers
8k views

How to migrate a regular LXC container to a Proxmox LXC container?

How do you migrate a regular LXC container (from another or the same server) to a Proxmox LXC container, which can be accessed via the Proxmox web GUI? For example, I have a container created by ...
1
vote
1answer
2k views

Replaced a dead disk in a ZFS pool. After resilvering finished, the status look weird :/

I replaced a dead disk in a ZFS pool (on FreeNAS-11.1-U6.3) following the hints I found at Need to replace disk in zpool ... confused ... # zpool replace raid2 gptid/f00-whatever-id-that-was-...
8
votes
1answer
489 views

What ZFS file structure to use for zfs-root linux system?

In ZFS, you can build your filesystem hiearchy to include different fs-attributes per filesystem. For insance, compression in one area, no-exec/suid in others, noatime. For example, a HOWTO for ...
2
votes
0answers
486 views

ZFS Faulted Pool Corrupted Data, resilver completed, incorrect paths, io error

I recently encountered a disk failure, for which I got a replacement disk, and successfully replaced the disk as well as completed the resilvering process. I was able to use the raidz2 without issues ...
4
votes
1answer
1k views

What is the correct option for Samba's “strict allocate” when serving a zfs volume?

What is the correct option for Samba's "strict allocate" when serving a zfs volume? The documentation says: This is a boolean that controls the handling of disk space allocation in the server. ...
6
votes
1answer
348 views

FIO Benchmarking - Inconsistent and Slower than Anticipated: Are my RAIDs Misconfigured?

TL;DR: I'm having some performance issues with my hypervisor storage. here are a bunch of test results from fio. Skip to the Results section to read about them and see my questions. Summary I ...
32
votes
9answers
29k views

Is bit rot on hard drives a real problem? What can be done about it?

A friend is talking with me about the problem of bit rot - bits on drives randomly flipping, corrupting data. Incredibly rare, but with enough time it could be a problem, and it's impossible to detect....
2
votes
1answer
48 views

How do I repair a corrupt file on a ZFS replica?

I have two machines: one that has the main 24TB ZFS filestore and one that is a clone of that filestore as a backup. Every now and then, I create a new snapshot on the primary and perform a ...
0
votes
0answers
61 views

Similar ZFS performance on HDD and SSD

I've created two zfs pools (one with ssds, the other rust) and run bonnie against each to try to understand their performance but I find the output somewhat confusing as the performance seems ...
1
vote
1answer
343 views

Unable to zpool drive: is in use and contains a unknown filesystem

Created raidz1 drive array on CentOS8. Five drives and after reboot zpool would not load. Did a zpool import -a, to import the zpool and datasets. I had a missing drive, which bugs me to no avail, I'...
1
vote
0answers
16 views

Should I partition or format a disk before replacing a FAULTED disk in a ZFS pool?

I recently had a FAULTED disk in a ZFS pool and wanted to replace it. I simply put the disk in and let it resilver. Afterwards, I noticed the disk was partitioned differently than the other disks and ...
5
votes
1answer
2k views

ZFS ARC size vs target size

I am trying to understand the inner workings of the ZFS ARC. However, I am confused with several things: actual (zfs:0:arcstats:size) vs target size (zfs:0:arcstats:c). I understand that actual size ...
4
votes
3answers
237 views

I can not remove the “bad” disk from the zfs pool

There were 2 disks in the pool /dev/sde /dev/sdf The disk /dev/sde was damaged, I excluded it from the pool and replaced it with a new disk. The raid has become degraded. After adding a new /dev/...
2
votes
2answers
161 views

ZFS modules suddenly stopped loading - Debian 10

My ZFS modules have mysteriously stopped loading at the point during boot when you would usually unlock the pool with encrypted ZFS on root (Debian 10). It drops into busybox and suggests loading the ...

1
2 3 4 5
25