Questions tagged [zfsonlinux]
zfsonlinux provides a native Linux kernel port of the ZFS filesystem so that ZFS may run natively on Linux. It is very different from ZFS-fuse which provides ZFS on top of a userspace-filesystem layer. The ZFS On Linux project is hosted on zfsonlinux.org.
264
questions
0
votes
0
answers
16
views
Persistent ZFS pool errors on Ubuntu, even after repeated scrubs
My 3-disk ZFS pool has been scrubbed several times after replacing failing disks.
"zpool status -v" provided a list of files which were deleted and removed a good number of errors.
Despite ...
0
votes
1
answer
39
views
Samba and ZFS resulting in NT_STATUS_BAD_NETWORK_NAME
I am currently trying to share my ZFS dataset using SMB. Unfortunately I receive the error NT_STATUS_BAD_NETWORK_NAME every time I try to connect to the share. The error does not make much sense to me ...
- 1
1
vote
1
answer
104
views
ZFS on Hetzner Rescue fails with `checking whether inode_owner_or_capable() takes user_ns... configure: error:`
Normally, when booting into the Hetzner rescue system, using the 'zfs' command will automatically install zfs tooling inside the rescue system.
This is currently not working;
checking whether ...
- 289
0
votes
0
answers
44
views
automatic mounting of encrypted zfs dataset
As a newbie to zfs, I am having trouble getting an encrypted dataset mounted during boot.
The dataset is protected with a raw key and not a passphrase.
This is how I created the zpool and the dataset:
...
- 43
3
votes
0
answers
77
views
zfs pool with slow speed on SAS drive with high latency
We have 3 servers in a gluster pool.
Each computer's spec is (Advance STOR-2 Gen 2 at OVH):
AMD Ryzen 7 Pro 3700 - 8c/16t - 3.6 GHz/4.4 GHz
6 x 14 TB disk (WD DC HC 530, using CMR technologies) ...
- 31
1
vote
1
answer
108
views
How to explain that ZFS' snapshot reports 'WRITTEN' as 4.26GB, but the transfer size is actually 31.4GB?
When I run this query on a dataset
zfs list -d 1 -t all -o name,used,refer,written,compressratio sfg-backup/mx
I see the following stats:
zfs list -d 1 -t all -o name,used,refer,written,compressratio ...
- 317
1
vote
1
answer
56
views
Forcefully forget / unmount ZFS pool after drives disconnected
First off, I made a mistake & I acknowledge that, but now I'm stuck with a "broken" ZFS driver and want to restore it without rebooting my machine.
How I can say ZFS on Linux to just ...
- 81
0
votes
0
answers
64
views
Unexpected ZFS async write performance at different queue depths
For some reason, QD2 seems to be the best in terms of raw IOPS...
After seeing an interesting article comparing a couple different drives for SLOG usage, I got curious about the performance of my own ...
- 109
0
votes
1
answer
291
views
ZFS pool disappears and says "I/O error" because of one missing device
I had a ZFS pool named data with 3 disks. Two disks were attached to the raidz by ID, but the third one was attached by volume (sda). I physically removed the sda device because I wanted to attach it ...
- 529
0
votes
1
answer
343
views
ZFS send/receive fails, target has been modified, because of a zfs userspace query?
I use zfs send/receive to replicate a zfs file system to another server every day. The workflow is the standard send receive:
# 1. create snapshot on source
zfs snapshot ${source_fs}@${today}
# 2. ...
- 507
2
votes
3
answers
444
views
How to nest & share multiple ZFS pools over Samba to multiple users
I have the following ZFS structure:
% sudo zfs list 16:03:46
NAME USED AVAIL REFER MOUNTPOINT
zpool1 ...
- 69
0
votes
0
answers
462
views
Slow read speed in ZFS mirror (slower than write speed, and very slow for small chunk sizes)
I have a server running debian on top of a ZFS 3-way mirror of Exos X18 18TB (ST18000NM001J).
I'm benchmarking it and I'm finding some surprises for the read rate under certain conditions.
But first, ...
- 141
0
votes
1
answer
182
views
How ZFS avoids inodes' number exhaustion and why wasn't it implemented in previous filesystems (e.g. ext4)?
Chapter 1 of Oracle's ZFS Guide states that
all metadata is allocated dynamically, so no need exists to preallocate inodes
which was a positive surprise, but makes me wonder why the methods ZFS uses ...
2
votes
1
answer
49
views
ZFS: Replace raidz1-member of a striped pool for raidz2
I have a pool (in Ubuntu 20 LTS) like this:
# zpool status
pool: zpool_test
state: ONLINE
scan: none requested
config:
NAME STATE READ WRITE CKSUM
zpool_test ONLINE 0 ...
- 21
0
votes
0
answers
124
views
ZoL+FIO Randwrite nvme bs=8k@32io = 148MiB/s?
Sorry for the title, but it's very short summary of BS that I'm looking into. Situation
I'm using ZoL 2.1.5 (from jonathonf's ppa) on Ubuntu (tried 20.04&22.04)
I have following NVMe disk
...
0
votes
1
answer
663
views
How can I list what zfs compression algorithms are available?
I have a zfs pool on a production system and I would like to see if it's possible to use zstd compression instead of the current gzip setting.
Is there any way to list available compression options?
- 31
1
vote
1
answer
98
views
ZFS size discrepency between 2 very similar configurations
I have 20X sata 12TB disks in a file server with a Broadcom/LSI MegaRAID SAS39xx raid controller. It’s running ubuntu. For an performance experiment, I created two storage pools:
-A single hardware ...
- 33
1
vote
0
answers
281
views
On Linux ZFS Server - What is eating my memory?
Our monitoring tool regularly reports low memory for one of our servers running ZFS.
# free -g
total used free shared buff/cache available
Mem: 125 ...
- 11
2
votes
1
answer
285
views
ZFS disk with Postgresql fragmenting quickly with write-heavy application
I am running a write-heavy application where I am storing my Postgresql on ZFS. Generally, it works well, but I am finding that my ZFS pool is fragmenting heavily. I even created a new ZFS pool and ...
- 131
3
votes
1
answer
1k
views
zfs: flush cache without exporting
For testing I need zfs' cache to be cold.
I can flush caching from the pool by removing the cache disks, exporting and importing the pool. This gives the effect I want. But would really like not to ...
- 2,906
0
votes
1
answer
441
views
Import a ZFS pool from a disk snapshot of another machine
I have a server on Azure with a disk mounted that contains a ZFS filesystem.
I also have a snapshot of the disk (taken from Azure, not zfs snapshot) which I want to mount to a new server.
The disk ...
0
votes
1
answer
218
views
Zpool permanent error for raidz2
Problem: Zpool shows "errors: Permanent errors have been detected in the following files: tank/vms/fileserver:<0x0>
Server has six 12Tb drives in a raidz2. These are spinning drives.
Zpool ...
- 1
0
votes
1
answer
631
views
Remove Missing Drives from ZFS Pool
After an embarrassing session trying to replace a disk in my ZFS pool, I have a bunch of entries representing disks that are no longer present in the system:
NAME STATE READ ...
1
vote
0
answers
154
views
ZFS/ZoL: Consequences of increasing zfs_vdev_async_read_min_active (and max)?
Vdev async read queues have min=1 and max=3 by default. All sync read/write queues are defaulted to min=max=10, while async writes get min=2 and max=10.
Async reads are described as "prefetch ...
- 111
0
votes
1
answer
214
views
Multipass mount folder on zfs file system - Source path does not exist
I am trying to add storage to an existing Multipass VM. I created a new ZFS filesystem, mounted locally at /zfs/morespace. Then tried to mount it with
multipass mount /zfs/morespace existingvm:/mnt/...
- 11
1
vote
0
answers
253
views
ZFS send/recv full snapshot
I have been backing up my ZFS pool in Server A to Server B (backup server) via zfs send/recv, and using daily incremental snapshots.
Due to hardware issues, the ZFS pool in Server A is now gone - and ...
1
vote
2
answers
411
views
How can one recover/write a label (clone existing one)?
ZFS stores 4 labels, 2 at the beginning of a device, 2 at the end. When they are corrupted a pool cannot be mounted.
I had a case of 3 broken labels (failed to unpack), but 1 was still intact. I could ...
- 258
1
vote
2
answers
2k
views
Limiting ARC Size for the proposed system
I have a pool of 5 x enterprise 12Gps SSD that I use for internal storage for a proxmox server. This pool is used to stand up VMs and containers.
The problem is that it is eating up a lot of my ...
- 121
2
votes
2
answers
132
views
Frozen boot due to slow disk/controller
Im running ubuntu 20.04 on dell r740xd, One of the disk controller seem to present the disk(multipath disks used for openzfs pool) slow while the server is booting. If the server is boot from '...
- 616
1
vote
0
answers
298
views
ZFS disk error on write
our ZFS backup pool is producing strange disk errors when writing data. This pool is replicated via DRBD on a second server with identical hardware which is also experiencing the same errors. This is ...
- 11
1
vote
1
answer
752
views
Recovering data from a zpool with a missing device
I have a zpool consisting of two mirrored drives, storing all my personal data. I wanted to add another mirror drive, since the other drives have been in use for several years now. Instead, I managed ...
- 131
0
votes
1
answer
304
views
Does zfs zfs recv validate checksums?
It seems that zfs send includes a checksum for all included data (stated for instance here). Is this checksum automatically verified by zfs recv? I would assume it is, but I cannot find any ...
- 357
1
vote
1
answer
723
views
ZFS datasets wont mount after upgrade to ubuntu 21.10
So i recently upgraded from Ubuntu 21.04 to 21.10 and now my ZFS datasets wont mount, even manually using the forced option.
I have tried exporting the pool and re-importing the pool, but even trying ...
- 11
5
votes
2
answers
4k
views
Does it make sense to create a zpool with lots of mirror vdevs?
To prefix, I am rather new to ZFS. My goal is to create an internal NAS system, with minimal chance of losing all my data.
I've currently acquired four 4TB disks, and I plan to run them in a single ...
- 346
0
votes
1
answer
549
views
Is there an advantage to using discreet ZFS datasets/filesystems in a single zpool?
I have a Centos server utilizing ZFS on Linux. The disks are in a single zpool. When you type in zfs list it shows a single filesystem(?)(dataset?), tank1.
NAME USED AVAIL REFER ...
- 161
1
vote
3
answers
4k
views
Erratic (terrible) Disk Performance I/O (Debian/Proxmox)
Summary
I'm seeing dramatically fluctuating I/O performance on a ZFS SSD mirror in Proxmox VE 7 (Bullseye). I'm simply too much of a novice to be able to track it down on my own.
Details
This is VERY ...
- 11
2
votes
2
answers
620
views
.zfs folder's missing, but snapshots are still there and mountable (inode trouble?)
$ sudo zfs list -t snapshot | grep childDataset3
a whole bunch are listed as expected (e.g. pool/dataset/childDataset3@today)
$ ls /pool/dataset/childDataset3/.zfs
ls: cannot access '/pool/dataset/...
0
votes
0
answers
292
views
ZFS Pool Disk faulted. Offlined and replaced and now I am stuck
Original fault:
pool: datastore7
state: DEGRADED
status: One or more devices could not be used because the label is missing or
invalid. Sufficient replicas exist for the pool to continue
functioning ...
- 15
0
votes
1
answer
162
views
ZFS Transfer extremely bursty
I am testing a new ZFS configuration with z-std for log storage and storage of highly compressible files.
The Array is tested on a 5 drive raidz-1 in a virtual machine on my PC which has direct access ...
- 11
2
votes
1
answer
981
views
Sequential write to zvol is much slower than to a dataset on the same zpool
While experimenting with Proxmox VE, we have encountered a strange performance problem:
VM disks can be stored (among other options) as individual raw ZFS zvols, or as qcow2 files on a single common ...
- 776
3
votes
1
answer
1k
views
Are ZFS snapshots really "free"?
I've heard many times that ZFS snapshots are "free", that because of ZFS' copy-on-write design snapshots do not consume any disk space unless data is changed, and only then the space usage ...
- 9,130
1
vote
1
answer
1k
views
Linux mountpoint can not be unmounted no matter what?
I have a mount point in Linux that does not show any open files in lsof or fuser. The mount point was exported in NFS, but is no longer exported, and there are no more files or directories in the ...
- 296
3
votes
0
answers
99
views
ZFS missing filesystem after interrupted backup
I have two filesystems in a pool, backup/nextcloud and backup/vm. Today, after a send/receive transfer was interrupted before it could finish (I was backing stuff up to these filesystems), I no longer ...
- 31
4
votes
1
answer
579
views
ZFS: device vdev wandered faulting zpool
I have a zpool thats now showing in a FAULTED state after a power outage rebooted the server & devices names got thrown around.
I understand I messed up by adding vdevs by device name, but didnt ...
- 43
2
votes
1
answer
301
views
Mount ZFS pool before snapd starts
I have a zpool that has a mountpoint at /var. When I start my server up, the snapd service always throws a bunch of errors and fails to start because it attempts to mount a bunch of things from /var ...
- 123
2
votes
1
answer
92
views
Monitor ZFS shrink events
I am using ZFS with Proxmox (debian based). The system has enough free RAM but I am close to hitting the point where ARC shrinking could be trigered.
I would like to monitor these events, or at least ...
- 1,244
0
votes
1
answer
1k
views
ZFS 2.0: How can I lower CPU-load on write with very slow disks and weak CPU?
I have a small 32bit-ARM-based board with three disk attached via USB 2.0. This has been running fine with ZFS 0.7.1 and 0.6.x for a long time, and I do not mind the reduced disk performance. (I am ...
- 326
2
votes
1
answer
921
views
ZFS slow scrub on two HDDs
The pool consist of two HDDs (WD Red 3 TB, 5200 RPM?, max transfer rate 147 MB/s & Verbatim (Toshiba) 3 TB, 7200 RPM) in raidz1-0 configuration. It has 2.25 TB of data, duplicated to two disks so ...
- 161
4
votes
1
answer
547
views
Incorrect cache device after ZFS import
I've recently migrated from an Ubuntu machine to an Arch Linux machine.
I imported the pool using the zpool import -f tank and it reported my cache drive as faulted, but my storage drives are working ...
- 227
1
vote
0
answers
1k
views
How to boot ZFS root filesystem after setting dnodesize = auto (making grub unable to read the disks)
I have a proxmox (v5.4 I think) installation on top of ZFS in a server with 6 disks. There are 2 pools: rpool in a mirror of two SSDs that has the proxmox root filesystem and some containers and zvols....
- 141