Questions tagged [zfsonlinux]

zfsonlinux provides a native Linux kernel port of the ZFS filesystem so that ZFS may run natively on Linux. It is very different from ZFS-fuse which provides ZFS on top of a userspace-filesystem layer. The ZFS On Linux project is hosted on zfsonlinux.org.

Filter by
Sorted by
Tagged with
2 votes
1 answer
40 views

ZFS disk with Postgresql fragmenting quickly with write-heavy application

I am running a write-heavy application where I am storing my Postgresql on ZFS. Generally, it works well, but I am finding that my ZFS pool is fragmenting heavily. I even created a new ZFS pool and ...
user avatar
  • 131
1 vote
0 answers
83 views

zfs: flush cache without exporting

For testing I need zfs' cache to be cold. I can flush caching from the pool by removing the cache disks, exporting and importing the pool. This gives the effect I want. But would really like not to ...
user avatar
  • 2,746
0 votes
1 answer
84 views

Import a ZFS pool from a disk snapshot of another machine

I have a server on Azure with a disk mounted that contains a ZFS filesystem. I also have a snapshot of the disk (taken from Azure, not zfs snapshot) which I want to mount to a new server. The disk ...
user avatar
0 votes
1 answer
48 views

Zpool permanent error for raidz2

Problem: Zpool shows "errors: Permanent errors have been detected in the following files: tank/vms/fileserver:<0x0> Server has six 12Tb drives in a raidz2. These are spinning drives. Zpool ...
user avatar
  • 1
0 votes
1 answer
125 views

Remove Missing Drives from ZFS Pool

After an embarrassing session trying to replace a disk in my ZFS pool, I have a bunch of entries representing disks that are no longer present in the system: NAME STATE READ ...
user avatar
0 votes
0 answers
179 views

zfs-import@pool.service fails to start at boot

I just installed proxmox(7.1-2), setup a zfs pool and added a NFS share. But on every boot the service zfs-import@asgard.service fails to start, but if I look in the /asgard directory everything seems ...
user avatar
  • 343
0 votes
0 answers
36 views

ZFS/ZoL: Consequences of increasing zfs_vdev_async_write_min_active?

By default zfs_vdev_async_write_min_active=2, with a corresponding max of 10. The same default max of 10 applies to the sync read and write queues, but for them the min is also 10. I've seen configs ...
user avatar
  • 111
1 vote
0 answers
59 views

ZFS/ZoL: Consequences of increasing zfs_vdev_async_read_min_active (and max)?

Vdev async read queues have min=1 and max=3 by default. All sync read/write queues are defaulted to min=max=10, while async writes get min=2 and max=10. Async reads are described as "prefetch ...
user avatar
  • 111
0 votes
0 answers
46 views

Multipass mount folder on zfs file system - Source path does not exist

I am trying to add storage to an existing Multipass VM. I created a new ZFS filesystem, mounted locally at /zfs/morespace. Then tried to mount it with multipass mount /zfs/morespace existingvm:/mnt/...
user avatar
1 vote
0 answers
114 views

ZFS send/recv full snapshot

I have been backing up my ZFS pool in Server A to Server B (backup server) via zfs send/recv, and using daily incremental snapshots. Due to hardware issues, the ZFS pool in Server A is now gone - and ...
user avatar
0 votes
1 answer
91 views

How can one recover/write a label (clone existing one)?

ZFS stores 4 labels, 2 at the beginning of a device, 2 at the end. When they are corrupted a pool cannot be mounted. I had a case of 3 broken labels (failed to unpack), but 1 was still intact. I could ...
user avatar
  • 248
1 vote
1 answer
253 views

Limiting ARC Size for the proposed system

I have a pool of 5 x enterprise 12Gps SSD that I use for internal storage for a proxmox server. This pool is used to stand up VMs and containers. The problem is that it is eating up a lot of my ...
user avatar
  • 111
2 votes
2 answers
60 views

Frozen boot due to slow disk/controller

Im running ubuntu 20.04 on dell r740xd, One of the disk controller seem to present the disk(multipath disks used for openzfs pool) slow while the server is booting. If the server is boot from '...
user avatar
1 vote
0 answers
77 views

ZFS disk error on write

our ZFS backup pool is producing strange disk errors when writing data. This pool is replicated via DRBD on a second server with identical hardware which is also experiencing the same errors. This is ...
user avatar
  • 11
1 vote
1 answer
270 views

Recovering data from a zpool with a missing device

I have a zpool consisting of two mirrored drives, storing all my personal data. I wanted to add another mirror drive, since the other drives have been in use for several years now. Instead, I managed ...
user avatar
  • 131
0 votes
1 answer
95 views

Does zfs zfs recv validate checksums?

It seems that zfs send includes a checksum for all included data (stated for instance here). Is this checksum automatically verified by zfs recv? I would assume it is, but I cannot find any ...
user avatar
  • 317
0 votes
0 answers
79 views

Is a ZVOL considered copy-on-write anymore if I format it with another filesystem?

According to official requirements from Microsoft, SQL Server 2019 only supports either ext4 or xfs. I suspect that a Copy-On-Write filesystem such as btrfs or zfs may hurt the performance of the ...
user avatar
  • 153
0 votes
0 answers
81 views

Understanding output of zpool status and physically identify faulted disk

I have a ZFS running on an Ubuntu 20.04 server that currently is running in degraded state due to a faulted disk. The output of zpool status looks as follows: me@server:~$ zpool status tank pool: ...
user avatar
  • 13
1 vote
1 answer
363 views

ZFS datasets wont mount after upgrade to ubuntu 21.10

So i recently upgraded from Ubuntu 21.04 to 21.10 and now my ZFS datasets wont mount, even manually using the forced option. I have tried exporting the pool and re-importing the pool, but even trying ...
user avatar
3 votes
2 answers
1k views

Does it make sense to create a zpool with lots of mirror vdevs?

To prefix, I am rather new to ZFS. My goal is to create an internal NAS system, with minimal chance of losing all my data. I've currently acquired four 4TB disks, and I plan to run them in a single ...
user avatar
  • 306
0 votes
1 answer
196 views

Is there an advantage to using discreet ZFS datasets/filesystems in a single zpool?

I have a Centos server utilizing ZFS on Linux. The disks are in a single zpool. When you type in zfs list it shows a single filesystem(?)(dataset?), tank1. NAME USED AVAIL REFER ...
user avatar
  • 131
0 votes
1 answer
2k views

Erratic (terrible) Disk Performance I/O (Debian/Proxmox)

Summary I'm seeing dramatically fluctuating I/O performance on a ZFS SSD mirror in Proxmox VE 7 (Bullseye). I'm simply too much of a novice to be able to track it down on my own. Details This is VERY ...
user avatar
  • 1
1 vote
2 answers
298 views

.zfs folder's missing, but snapshots are still there and mountable (inode trouble?)

$ sudo zfs list -t snapshot | grep childDataset3 a whole bunch are listed as expected (e.g. pool/dataset/childDataset3@today) $ ls /pool/dataset/childDataset3/.zfs ls: cannot access '/pool/dataset/...
user avatar
0 votes
0 answers
166 views

ZFS Pool Disk faulted. Offlined and replaced and now I am stuck

Original fault: pool: datastore7 state: DEGRADED status: One or more devices could not be used because the label is missing or invalid. Sufficient replicas exist for the pool to continue functioning ...
user avatar
0 votes
1 answer
81 views

ZFS Transfer extremely bursty

I am testing a new ZFS configuration with z-std for log storage and storage of highly compressible files. The Array is tested on a 5 drive raidz-1 in a virtual machine on my PC which has direct access ...
user avatar
0 votes
1 answer
267 views

Sequential write to zvol is much slower than to a dataset on the same zpool

While experimenting with Proxmox VE, we have encountered a strange performance problem: VM disks can be stored (among other options) as individual raw ZFS zvols, or as qcow2 files on a single common ...
user avatar
  • 736
2 votes
1 answer
720 views

Are ZFS snapshots really "free"?

I've heard many times that ZFS snapshots are "free", that because of ZFS' copy-on-write design snapshots do not consume any disk space unless data is changed, and only then the space usage ...
user avatar
  • 8,921
1 vote
1 answer
610 views

Linux mountpoint can not be unmounted no matter what?

I have a mount point in Linux that does not show any open files in lsof or fuser. The mount point was exported in NFS, but is no longer exported, and there are no more files or directories in the ...
user avatar
3 votes
0 answers
59 views

ZFS missing filesystem after interrupted backup

I have two filesystems in a pool, backup/nextcloud and backup/vm. Today, after a send/receive transfer was interrupted before it could finish (I was backing stuff up to these filesystems), I no longer ...
user avatar
  • 31
4 votes
1 answer
405 views

ZFS: device vdev wandered faulting zpool

I have a zpool thats now showing in a FAULTED state after a power outage rebooted the server & devices names got thrown around. I understand I messed up by adding vdevs by device name, but didnt ...
user avatar
  • 43
1 vote
1 answer
139 views

Mount ZFS pool before snapd starts

I have a zpool that has a mountpoint at /var. When I start my server up, the snapd service always throws a bunch of errors and fails to start because it attempts to mount a bunch of things from /var ...
user avatar
  • 113
2 votes
1 answer
64 views

Monitor ZFS shrink events

I am using ZFS with Proxmox (debian based). The system has enough free RAM but I am close to hitting the point where ARC shrinking could be trigered. I would like to monitor these events, or at least ...
user avatar
  • 1,233
0 votes
1 answer
919 views

ZFS 2.0: How can I lower CPU-load on write with very slow disks and weak CPU?

I have a small 32bit-ARM-based board with three disk attached via USB 2.0. This has been running fine with ZFS 0.7.1 and 0.6.x for a long time, and I do not mind the reduced disk performance. (I am ...
user avatar
  • 316
2 votes
1 answer
447 views

ZFS slow scrub on two HDDs

The pool consist of two HDDs (WD Red 3 TB, 5200 RPM?, max transfer rate 147 MB/s & Verbatim (Toshiba) 3 TB, 7200 RPM) in raidz1-0 configuration. It has 2.25 TB of data, duplicated to two disks so ...
user avatar
  • 161
4 votes
1 answer
390 views

Incorrect cache device after ZFS import

I've recently migrated from an Ubuntu machine to an Arch Linux machine. I imported the pool using the zpool import -f tank and it reported my cache drive as faulted, but my storage drives are working ...
user avatar
1 vote
0 answers
699 views

How to boot ZFS root filesystem after setting dnodesize = auto (making grub unable to read the disks)

I have a proxmox (v5.4 I think) installation on top of ZFS in a server with 6 disks. There are 2 pools: rpool in a mirror of two SSDs that has the proxmox root filesystem and some containers and zvols....
user avatar
  • 11
2 votes
0 answers
51 views

zfs diff gives error on encrypted dataset (Key must be loaded to discover path names: Permission denied)

I'm running the following on Debian 10: zfs-0.8.4-2~bpo10+1 zfs-kmod-0.8.4-2~bpo10+1 I have a 2TB (passphrase encrypted) dataset used by many colleagues. I am also using Zabbix for monitoring, and ...
user avatar
  • 333
0 votes
1 answer
1k views

zfs cannot create snapshot, out of space

I have a disk with these layers: sata disk, luks, zpool, ext4 The ext4 fs was created with these commands: cryptsetup -v luksFormat /dev/sdb cryptsetup luksOpen /dev/sda store02 zpool create zstore02 /...
user avatar
  • 657
5 votes
0 answers
2k views

What is the easiest way to encrypt an existing ZFS dataset?

I would like to convert a lot of ZFS datasets I have on a (Ubuntu 20.04) server (about 3 TB of data). I've already tested this a bit, and what I've been doing so far is: Create a new encrypted ...
user avatar
  • 333
1 vote
1 answer
126 views

HDD bad sector marking through LUKS2 layer (dm-crypt) + ZFS

If having 2x LUKS-encrypted HDDs with a ZFS mirror pool on top of the dm-crypt mapper devices: what happens if one of my HDDs encounters an error and the OS recognizes a sector as bad ? Will this bad ...
user avatar
  • 13
1 vote
1 answer
576 views

Proxmox - Can't mount encrypted ZFS dataset - zfs mount fails sillently without an error

I have problems with mounting encrypted zfs dataset after boot. Pool is properly imported and visible in zpool status output. Then I manually load keys with: zfs load-key -a - still no issues. And ...
user avatar
  • 11
1 vote
1 answer
2k views

zfs send multiple snapshots

I want send several zfs snapshots to another pool. Source pool "rpool", target pool "dpool" rpool/kvm1380_img 88,6G 1,48T 77,6G - rpool/...
user avatar
2 votes
0 answers
752 views

zfs, zpool list no pools avaliable, and zpool import no pools available to import

I have a zpool with four disks: /dev/disk/by-id/ata-SAMSUNG_HD103SJ_S246J9AZB03256 /dev/disk/by-id/ata-SAMSUNG_HD103SJ_S2NWJ50BB01630 /dev/disk/by-id/ata-SAMSUNG_HD103UJ_S13PJ90S328545 /dev/disk/by-...
user avatar
0 votes
0 answers
224 views

ZFS entering D-State at random

I am running ZFS on Ubuntu 20.04 LTS ontop of hyper-v. At random, currently every 2-3 days, ZFS gets stuck. Samba is non-responsive, File I/O via smb to the ZFS volume ceases and actions on the shell ...
user avatar
2 votes
2 answers
622 views

Use QLC SSDs as RAIDZ (scientific archive)?

We are building a system for the archival and scientific analysis of some weather data. The setup is redundant, with two HP DL580, Proxmox (ZoL) and some GPUs for analysis. On each server we plan 5 ...
user avatar
  • 101
1 vote
0 answers
117 views

Should I partition or format a disk before replacing a FAULTED disk in a ZFS pool?

I recently had a FAULTED disk in a ZFS pool and wanted to replace it. I simply put the disk in and let it resilver. Afterwards, I noticed the disk was partitioned differently than the other disks and ...
user avatar
  • 121
6 votes
3 answers
1k views

TRIM/UNMAP Zvol over iSCSI

I am currently setting up a SAN for diskless boot. My backend consists of ZFS-Vol shared via iSCSI. So far everything is working just fine except for TRIM/UNMAP. For test puposes I setup two VMs ...
user avatar
0 votes
1 answer
225 views

Linux does STDOUT | STDIN piping write data to disk?

I was planning on passing encryption keys to zfs load-key pool/set through stdin. The keys passed are generated by another program in HEX format and dataset is configured to have keylocation=prompt, ...
user avatar
1 vote
1 answer
453 views

ZFS configuration for Ubuntu 20.04

TL;DR I have three 2 TB drives and one 500 GB drive in a machine running Ubuntu 20.04 with a default ZFS install on the small drive. My plan is to partition the larger drives into two partitions each, ...
user avatar
0 votes
1 answer
600 views

Remove a ZFS attribute instead of setting its value to default?

I added a ZFS property which was not included by default. Instead of setting it back to true (default value), is there a way to "remove" the attribute I created? root@library:~# zfs get all |...
user avatar
  • 2,082

1
2 3 4 5