Questions tagged [zfs]

ZFS is a modern file system and volume manager originally developed by Sun Microsystems and licensed under the CDDL. It is a copy-on-write file system with support for large storage arrays, protection against corruption, snapshots, clones, compression, deduplication and NFSv4 ACLs. An open-source fork of ZFS can be found at http://open-zfs.org/ , which is supported by ZFSonlinux.org, illumos.org and ZFS developers in the FreeBSD & Mac OS X communities.

Filter by
Sorted by
Tagged with
0
votes
0answers
13 views

Cache configuration for PostgreSQL/TimescaleDB VM on ZFS with proxmox

I have a proxmox cluster of a single node and I want to start a new VM with a PostgreSQL and TimescaleDB and after a lot of reading about how to tune ZFS volumes for this purpose I still have some ...
0
votes
0answers
26 views

znapzend no longer works after upgrade to Ubuntu Server 20.04.1

Ubuntu Server was upgraded from 18.04 LTS to 20.04.1 LTS and subsequently znapzend service fails to start with the reason being: znapzend[3436]: ListUtil.c: loadable library and perl binaries are ...
2
votes
0answers
33 views

What is the easiest way to encrypt an existing ZFS dataset?

I would like to convert a lot of ZFS datasets I have on a (Ubuntu 20.04) server (about 3 TB of data). I've already tested this a bit, and what I've been doing so far is: Create a new encrypted ...
0
votes
0answers
18 views

Null bytes in mail from cron job calling zfSnap

I am using openmediavault 5.5.12-1 (Debian 10.6). I added a cron.d file /etc/cron.d/my-backup: PATH=/usr/local/sbin:/usr/local/bin:/sbin:/bin:/usr/sbin:/usr/bin MAILTO="me@domain.com" 0 0 * ...
1
vote
0answers
20 views

One of my pools disapears after reboot

One of my pools disappears after reboot. I have Debian Buster Root on ZFS and my bpool and rpool pools are OK. root@ZFSTEST:~# zpool status mkpool pool: mkpool state: ONLINE scan: scrub repaired ...
0
votes
1answer
43 views

file shared on SMB on zfs on linux cannot be read over network

The file can be opened locally. I think the problem is related to attributes or permissions somehow, but I do not know how to check them. The files are GoPro videos in a particular directory, and ...
3
votes
2answers
110 views

What is the overhead of ZFS RAIDz1/2 in HPC SSD Environment?

Example hardware / host: Modern 64 Core CPU, 128GB Memory 8 x Micron Pro 15.36TB u.2 SSDs SSDs connected by dedicated Oculink per device (no backplane or PCIe sharing) Ubuntu 20.04 Use case: A ...
1
vote
1answer
36 views

zfs send multiple snapshots

I want send several zfs snapshots to another pool. Source pool "rpool", target pool "dpool" rpool/kvm1380_img 88,6G 1,48T 77,6G - rpool/...
0
votes
1answer
71 views

Cannot see the right and used space on a ZFS dataset

I have set up a vm with debian buster and ZFS. Initially the machine booted from first hard drive, but added x4 20Gb hd and transfered the system to zfs for testing purposes. It works, so I added some ...
2
votes
2answers
75 views

ZFS data lost after a rollback happening on reboot

Edit1: Unlike what I originally thought when creating this question, it seems that the problem was NOT directly caused by the unplanned power-cycle, but by a mistake I might have done with beadm in ...
0
votes
0answers
18 views

Monitor ZFS iostats with collectd

I'm using ZFS on a server with lots of interesting IO, and I already use collectd to collect various interesting metrics. I already know about (and use) the zfs_arc plugin, which gives some of the ...
1
vote
0answers
79 views

zfs, zpool list no pools avaliable, and zpool import no pools available to import

I have a zpool with four disks: /dev/disk/by-id/ata-SAMSUNG_HD103SJ_S246J9AZB03256 /dev/disk/by-id/ata-SAMSUNG_HD103SJ_S2NWJ50BB01630 /dev/disk/by-id/ata-SAMSUNG_HD103UJ_S13PJ90S328545 /dev/disk/by-...
1
vote
0answers
46 views

Recently my NFS RAID performance has gone from very good to basically unusable

First, thanks for any help anyone is willing to give! I have two ubuntu 20.04 servers with two different software RAIDs on them. One is music and movies (RAID6) and the other is personal docs and ...
0
votes
0answers
26 views

ZFS entering D-State at random

I am running ZFS on Ubuntu 20.04 LTS ontop of hyper-v. At random, currently every 2-3 days, ZFS gets stuck. Samba is non-responsive, File I/O via smb to the ZFS volume ceases and actions on the shell ...
0
votes
0answers
43 views

How do I recursively list all NFS shares/datasets on OpenIndiana?

Running OpenIndiana 2020. Issuing zfs get sharenfs lists all NFS shares for the most part. But how can I see if any subdirectories have been shared with different properties? Selecting a filesystem ...
2
votes
1answer
35 views

ZFS - Deleting Redundant Snapshots

I have written a cron job to automatically create snapshots of ZFS dataset on an hourly basis for critical files that benefit from active tracking. The drawback of this is that these hourly snapshots ...
1
vote
1answer
48 views

Does IDs from `ls -l /dev/disk/by-id` output are unique to a disk? - DELL PERC card

Does output from ls -l /dev/disk/by-id can be used as a universal disk identifier? I am currently trying to find a unique identifier that I can use to create a ZFS raidz pool using a unique identifier ...
0
votes
1answer
33 views

ZFS - is it safe to remove files served by ZFS during a resilver/rebuild?

I have a Nexenta ZFS system serving a large NFS volume (using ~85% of 250 TB). One of the 70 disks failed over a week ago, and the system is resilvering a hot spare without issues (other than the ...
0
votes
0answers
20 views

Missing vdev in zpool?

I hadn't touched my home storage server for a year or two. I don't 100% remember what I did at the time. Now looking to expand. I remember that I added a second, 2 device mirror vdev to the zpool, but ...
1
vote
2answers
41 views

zfs is mounted after mongod starts: how do I set the boot order?

Fairly simple problem, I think, but I can't seem to get my head around a fix. I'm on Ubuntu 18.04.3 and mounting zfs volumes with mongo-data at boot correctly with the config below in /etc/systemd/...
1
vote
1answer
39 views

How can I monitor the reliability of connections to network shares?

I can use any of Windows Pro or Server Standard, or CentOS to do this monitoring (I guess). It seems there are some complex issues going on with AWS Deadline jobs which I don't expect anyone to know ...
2
votes
1answer
48 views

How do I repair a corrupt file on a ZFS replica?

I have two machines: one that has the main 24TB ZFS filestore and one that is a clone of that filestore as a backup. Every now and then, I create a new snapshot on the primary and perform a ...
1
vote
1answer
356 views

Unable to zpool drive: is in use and contains a unknown filesystem

Created raidz1 drive array on CentOS8. Five drives and after reboot zpool would not load. Did a zpool import -a, to import the zpool and datasets. I had a missing drive, which bugs me to no avail, I'...
1
vote
0answers
16 views

Should I partition or format a disk before replacing a FAULTED disk in a ZFS pool?

I recently had a FAULTED disk in a ZFS pool and wanted to replace it. I simply put the disk in and let it resilver. Afterwards, I noticed the disk was partitioned differently than the other disks and ...
0
votes
0answers
61 views

Similar ZFS performance on HDD and SSD

I've created two zfs pools (one with ssds, the other rust) and run bonnie against each to try to understand their performance but I find the output somewhat confusing as the performance seems ...
1
vote
1answer
81 views

How do I restore just part of a corrupted file on a zfs pool?

While running a scrub, zfs status -xv reports that a large (1TB) file has checksum errors. The docs say this can be fixed by "restoring the file" from a backup. I assume this just means cp /...
0
votes
0answers
37 views

Linux Can't Detect Some Hard Drives

I have a dell R820 with an LSI 9211-8i HBA installed. I connected one hard drive, a dell with model number HUC101890CSS204, and installed ubuntu 18.04 onto it from a usb stick. I then added 3 HGST ...
4
votes
3answers
243 views

I can not remove the “bad” disk from the zfs pool

There were 2 disks in the pool /dev/sde /dev/sdf The disk /dev/sde was damaged, I excluded it from the pool and replaced it with a new disk. The raid has become degraded. After adding a new /dev/...
4
votes
1answer
566 views

When does ZFS “autoreplace” take effect?

Background autoreplace is documented like the following: autoreplace=on | off Controls automatic device replacement. If set to "off", device replacement must be initiated by the ...
-2
votes
1answer
35 views

From ZFS Array CLI how to get the latest snapshot for share

from ZFS Array cli how to get the latest snapshot for share. my share name is "test_share" for this share want to check the latest snapshot. Test-ae0101zfs201:shares test_proj_test/...
1
vote
1answer
182 views

ZFS: arc_prune is using 100% CPU with high load average

I have a 4 disk storage server with two ZFS raidz1 pools, and suddenly last night it started running at 100% CPU with an high load average: root@stg1:~# w 07:05:48 up 296 days, 17:19, 1 user, load ...
2
votes
2answers
164 views

ZFS modules suddenly stopped loading - Debian 10

My ZFS modules have mysteriously stopped loading at the point during boot when you would usually unlock the pool with encrypted ZFS on root (Debian 10). It drops into busybox and suggests loading the ...
3
votes
1answer
75 views

Failing ZFS Raid-Z2, need to build new pool but lack a SAS port. Can I disconnect one drive from Raid-Z2?

I have a Raid-Z2 pool with 6 * 4TB drives. All the drives have a bit over 40 000 hours running time. Now they all seem to be degrading at the same time. The pool is degraded, and all drives are marked ...
2
votes
1answer
77 views

Why is the available space not increased when i increase the quota of the ZFS share?

I'm not very familiar with ZFS and need to increase the size of an ZFS share on our FreeNAS. When i do zpool list i see that we have 2 ZFS pools: NAME SIZE ALLOC FREE EXPANDSZ FRAG ...
1
vote
2answers
79 views

How to clear ZFS DEGRADED status in repaired pool

I got my first drive failure after a couple of years of maintaining this zpool so I did a zpool replace the drive with one of my spares. It took 60 hours (as shown below) to resilver the array but ...
0
votes
0answers
33 views

is there a way to clone the running lxc container without stopping it?

I am very new to the lxc container. I have been running the lxc containers over the zfs backing storage. For backup purpose i am using zfs snapshot. Now i got into problem while cloning the container ...
2
votes
1answer
193 views

Building a NAS, Raid vs HBA? [closed]

Building a NAS with the hardware below. I've been reading through the IXSystems forums as i'm thinking about using FreeNAS or Unraid for the OS. I see that ZFS requires HBA cards rather than raid ...
0
votes
0answers
74 views

Is using mbuffer safe on a public network for zfs send raw encrypted data?

I use ZFS send and receive to send incremental snapshots of an encrypted dataset in raw mode over SSH to a backup server using mbuffer over the internet. Using this strategy the transferspeed ...
0
votes
0answers
172 views

ZFS send/receive fails consistently with “Input/output error”

I have a ZFS disk with deduplication turned on. I have copied data from many other old hard disks onto this ZFS disk, ultimately with the intention of getting rid of all the original disks. I need ...
0
votes
0answers
20 views

zfs reducing a raidz3

I have... had (8) 3tb drives in a straight raidz3 configuration, now I have 7 working drives. Over the past year or so I thought I would end up using a majority of my zpool; it turns out I'm ...
1
vote
1answer
48 views

Barman: rsync wal archival stalls on some files

I'm archiving wal files from a postgres server via rsync, most of the time the archiving works fine and is quick, the speedtest for the connection is here: (this goes via the internet) [ ID] Interval ...
1
vote
0answers
66 views

ZFS RAIDZ1 root on gentoo fails to boot after disk swap

I have a 3-disk RAIDZ1 array with 3 HDDs: # zpool status ... config: NAME STATE READ WRITE CKSUM gpool ONLINE 0 0 0 raidz1-0 ONLINE 0 0 0 ...
1
vote
1answer
64 views

Setup with server and storage shelves for ~400TB on gigabit ethernet [closed]

Today i sketched out a storage setup, but since i am not very experienced with enterprise level storage, i would be very glad to have the concept reality checked by more experienced folks. ...
2
votes
1answer
95 views

Have docker create every volume as a separate ZFS filesystem

I enabled Docker's ZFS Storage Driver, but apparently it only deals with Docker internals, using ZFS snapshots and clones for its own overlays. But what I want is for Docker to create every volume, ...
1
vote
1answer
104 views

How does deleting the oldest ZFS snapshot not break the flow of data?

I'm not new to ZFS. I've been using it a couple of years but I've only just started making snapshots and I've created a cronjob and script to take a daily snapshot of a few of my datasets, which all ...
2
votes
1answer
355 views

How much PCI-E bandwidth can my SAS HDD array make use of?

Note: This question is real-world, but to analyse it, please note I've begun from a "theoretical" starting point of device and bus capability, which I acknowledge will not usually be at all ...
0
votes
0answers
22 views

Samba shadow copies not appearing for nested directories

I have a bunch of zfs datasets, each with its own snapshot being taken using zfs-auto-snapshot: /library /library/user /library/user/Originals /library/user/Originals/2020 However, when exported with ...
2
votes
1answer
125 views

zfs remove wrongly added device

I accidentally added a device as normal pool device instead of cache device. Is there a way undo this? (I basically forgot to type cache when adding the device) I can't remove it root@dmi-vault2:~# ...
1
vote
1answer
202 views

ZFS configuration for Ubuntu 20.04

TL;DR I have three 2 TB drives and one 500 GB drive in a machine running Ubuntu 20.04 with a default ZFS install on the small drive. My plan is to partition the larger drives into two partitions each, ...
0
votes
1answer
48 views

Remove a ZFS attribute instead of setting its value to default?

I added a ZFS property which was not included by default. Instead of setting it back to true (default value), is there a way to "remove" the attribute I created? root@library:~# zfs get all |...

1
2 3 4 5
25