Questions tagged [zfs]
ZFS is a modern file system and volume manager originally developed by Sun Microsystems and licensed under the CDDL. It is a copy-on-write file system with support for large storage arrays, protection against corruption, snapshots, clones, compression, deduplication and NFSv4 ACLs. An open-source fork of ZFS can be found at http://open-zfs.org/ , which is supported by ZFSonlinux.org, illumos.org and ZFS developers in the FreeBSD & Mac OS X communities.
1,423
questions
0
votes
0
answers
74
views
How to change keyformat of existing encrypted dataset
I had an unencrytped dataset that for which I used zfs send / receive to create an encrypted dataset with the data. The destination encrypted dataset used key-based creds. I would like to change this ...
- 101
1
vote
0
answers
40
views
zfs send to NAS with PIGZ compression slowness
The following command that I use to backup used to take 5 minutes to complete and since last week it is taking around 25 minutes. This is after restarting a switch stack the server is connected to. ...
- 11
0
votes
1
answer
320
views
ZFS I/O Error, Kernel Panic during import
I'm running a raidz1-0 (RAID5) setup with 4 data 2TB SSDs.
During midnight, somehow 2 of my data disks experience some I/O error (from /var/log/messages).
When I investigated in the morning, the zpool ...
2
votes
1
answer
128
views
zfs performance: split controller across mirrors vs splitting a mirror across controllers?
Suppose I have
4 disks split into 2 zfs mirrored pairs
2 sata controllers, where each can take 2 disks
Obviously, better expected uptime will be achieved by splitting each controller across both ...
- 123
1
vote
1
answer
259
views
ZFS: restore pool with detached drive
I have a Debian system installed on zfspool of 4 HDDs (like raid10 - raid0 of two raid1). And was displayed like set of 2 mirrors mirror0 and mirror1 each with 2 HDDs.
One of the disks became Faulted.
...
- 13
0
votes
2
answers
128
views
How does zfs know which snapshots to send with the `-I` flag?
From the manual:
A group of incremental snapshots can be combined into one snapshot by
using the zfs send -I option. For example:
# zfs send -I pool/fs@snapA pool/fs@snapD > /snaps/fs@all-I
How ...
- 101
0
votes
0
answers
31
views
Can I make running `zfs receive` without "-s" to save receive_resume_token by signal?
I am running a zfs send/receive. However I forget to set zfs receive -s.
Is this possible to inform a running zfs receive to save receive_resume_token by a signal sends from kill -s ?
Or is there ...
- 105
0
votes
0
answers
132
views
Rclone to a SFTP endpoint in a local network with a bunch of disks - suggested disks setup?
I have a need to copy a complex dataset (around 4 PB total, hundreds of millions of files) via Rclone copy, for some customers (each of them own around 100TB out of the 6PB) - to a bunch of disks via ...
- 65
4
votes
1
answer
739
views
How do I troubleshoot a zfs dataset that the server when the server can't agree if it's mounted or not?
I have a ZFS dataset that exists in /proc/mounts and in /etc/mtab, but the folder doesn't exist in the filesystem, zfs umount reports the dataset doesn't exist, and zfs mount reports that the dataset ...
- 151
0
votes
0
answers
128
views
Why isn't my zpool listed for export when plugged into new host?
I have a zpool called 'temp' with some data I'm trying to move between systems. I used zpool export temp to export the zpool, then I unplugged the disks, and installed them in my new computer. But now ...
- 333
0
votes
1
answer
113
views
Samba and ZFS resulting in NT_STATUS_BAD_NETWORK_NAME
I am currently trying to share my ZFS dataset using SMB. Unfortunately I receive the error NT_STATUS_BAD_NETWORK_NAME every time I try to connect to the share. The error does not make much sense to me ...
- 41
3
votes
1
answer
137
views
Pooled storage with varying redundancy per file system
I have some files that I want stored mirrored. I have some files that I only need single copies (i.e. scratch data, easily regenerated data, etc). And I have some files that are so critical, I want it ...
- 214
1
vote
1
answer
641
views
ZFS on Hetzner Rescue fails with `checking whether inode_owner_or_capable() takes user_ns... configure: error:`
Normally, when booting into the Hetzner rescue system, using the 'zfs' command will automatically install zfs tooling inside the rescue system.
This is currently not working;
checking whether ...
- 289
1
vote
0
answers
53
views
ZFS issues with reboot
After a reboot on Debian 11, I experienced 4 drives that just disappeared for no apparent reason. 2 are 'faulted' and 2 says they are unavailable.
Question: How do I identify the disks with the ...
- 11
2
votes
1
answer
154
views
How to explain that ZFS' snapshot reports 'WRITTEN' as 4.26GB, but the transfer size is actually 31.4GB?
When I run this query on a dataset
zfs list -d 1 -t all -o name,used,refer,written,compressratio sfg-backup/mx
I see the following stats:
zfs list -d 1 -t all -o name,used,refer,written,compressratio ...
- 337
2
votes
1
answer
589
views
Extremely slow MySQL writes in Ubuntu (ext4) guest on Promox 7.3-3 (ZFS) host
I'm trying out Proxmox 7.3-3 as a hypervisor and managed to install it using ZFS on my NVMe (Samsung_SSD_970_EVO_Plus_2TB_S6S2NS0T505403V)
I also installed a Ubuntu 22.04 VM and its filesystem is ext4
...
- 154
0
votes
1
answer
494
views
Uninstall ZFS installed via Ubuntu 20.04 installer
Apologies if this has been answered somewhere, I've searched everywhere and couldn't find anything.
I'm a PhD student and I manage a small cluster for our group. When installing Ubuntu 20.04 on our ...
2
votes
1
answer
704
views
Forcefully forget / unmount ZFS pool after drives disconnected
First off, I made a mistake & I acknowledge that, but now I'm stuck with a "broken" ZFS driver and want to restore it without rebooting my machine.
How I can say ZFS on Linux to just ...
- 113
2
votes
1
answer
360
views
ZFS Pool of USB Drives causes zsf-import-cache.service to fail on boot [closed]
I setup a ZFS pool on my "home server" (Raspberry Pi 4b) that consists of various HDD and SSD drives connected over USB to the Pi. I have noticed that whenever a reboot occurs, the ZFS pool ...
- 131
0
votes
0
answers
917
views
Bindmount External Drive In Proxmox for Nextcloud
I have a Proxmox LXC container with Nextcloud. The default data directory in Nextcloud requires the owner to be www-data with the default uid and gid of 33. I am using the following
Proxmox
Mount ...
1
vote
1
answer
706
views
Connecting from windows to debian Samba share
I have a proxmox installation with a few ZFS shares.
The shares are created using
zfs create storage/photos
sudo zfs set acltype=posixacl storage/photos
The user is created using
sudo adduser --...
- 376
0
votes
1
answer
649
views
Cloud-init installing packages on Debian with contrib sources
I need to install some zfs packages on Debian instances using cloud-init. One of the packages needs the contrib sources. I can get it to update the sources list, but the packages fail to install. If ...
- 23
1
vote
2
answers
476
views
Will disk compression impact the performance of a MySQL database?
I've recently setup a TrueNAS storage server and hosted on it is a MySQL database. It's about 3GB; I'm not too concerned with how much space it's utilising.
By default, TrueNAS enables LZ4 compression ...
- 113
3
votes
2
answers
4k
views
Possible to start a RAID1 setup with a single drive?
Can I start a ZFS pool with a RAID1 setup using a single drive, and then add another one later?
Running Proxmox VE 7.2
- 43
0
votes
0
answers
51
views
ZFS Not Recovering Space
I've certainly made a few rookie mistakes when setting up my first ZFS from a 4 drive array (14tb platters), mainly forgetting to change the block size from default. However I am missing space in my ...
- 101
1
vote
1
answer
454
views
zfs zpool dedup stat seems very wrong - how to interpret these values?
I run a fileserver receiving backups of user containers. Two containers are poorly run docker systems with hundreds of near-identical directories not using overlayfs nor zfs clones. (I cannot touch ...
- 265
2
votes
1
answer
417
views
Snaphot sizes in ZFS and syncoid backups of them
I got a question about ZFS snapshotting:
So, as far as I understand, when I take a snaphot of a ZFS dataset, the snapshot will be initially 0 bytes in size, because at the moment of creation, there is ...
0
votes
1
answer
804
views
ZFS pool disappears and says "I/O error" because of one missing device
I had a ZFS pool named data with 3 disks. Two disks were attached to the raidz by ID, but the third one was attached by volume (sda). I physically removed the sda device because I wanted to attach it ...
- 539
6
votes
2
answers
636
views
How to name drives according to their position in a multi-bay enclosure?
It is important to know a position of a bad drive in a multi-bay device, however default naming of drives e.g /dev/sda, /dev/sdb etc. does not provide a clue where a particular drive is residing ...
- 337
0
votes
1
answer
269
views
My ZFS pool seems to be self-destructing, any ideas?
Context
I recently noticed my freeNAS telling me it had issues with one drive.
I had about 16 bad sectors, went through the smart tests etc.
I bought a new drive, same capacity, went to install it, ...
- 317
2
votes
2
answers
357
views
Does the ZFS scrub support parallelization for increased performance, e.g., with a 64-core AMD Threadripper Pro?
I have a 24 drive zpool comprised of 3 RAIDZ1 vdevs running 8 Seagate Exos X18 16TB drives per vdev. This is on a Supermicro MB with a 64-Core (128 thread) AMD Threadripper Pro and 256GB ECC RAM.
...
- 29
4
votes
2
answers
1k
views
Why does ZFS RAIDZ2 only use 2GB of data when I create a 1GB File
I have created a ZFS RAIDZ2 / Raid 6 file system, which from what I believe will store parity on 2 disks.
root@zfs-demo:/data# zpool status
pool: data
state: ONLINE
config:
NAME ...
- 235
2
votes
3
answers
2k
views
Disadvantages of using ZFS recordsize 16k instead of 128k
I'm using Proxmox on a dedicated server. For production I'm still using ext4, but I decided to start messing around with ZFS.
So I have created two separate ZFS storage pools with diffrent recordsizes:...
- 157
0
votes
1
answer
1k
views
filesystem 'tank/volume' cannot be mounted, unable to open the dataset
I'm running ZFS and after zfs clone of a snapshot, I tried to mount the volume with command
mount -t zfs tank/volume /mnt
, but got an error message:
filesystem 'tank/volume' cannot be mounted, unable ...
- 301
0
votes
1
answer
1k
views
ZFS send/receive fails, target has been modified, because of a zfs userspace query?
I use zfs send/receive to replicate a zfs file system to another server every day. The workflow is the standard send receive:
# 1. create snapshot on source
zfs snapshot ${source_fs}@${today}
# 2. ...
- 507
0
votes
1
answer
128
views
How to activate HD indicator lights on Dell PowerEdge 710 in Linux
I have a particular drive that is failing (/dev/sdb)
I need to replace the failed drive but I am not sure which it is... I should have documented what drives were in what slots and what their devs ...
- 103
2
votes
3
answers
975
views
How to nest & share multiple ZFS pools over Samba to multiple users
I have the following ZFS structure:
% sudo zfs list 16:03:46
NAME USED AVAIL REFER MOUNTPOINT
zpool1 ...
- 69
3
votes
1
answer
590
views
How to repair zsysctl after manually deleting snapshots with `zfs destroy`?
I am running Linux Mint 20.3 with ZFS (including for /). Up until very recently, whenever I installed or removed packages, it would also create a snapshot so that I could select it when booting to ...
- 81
1
vote
1
answer
405
views
prevent zfs storage driver in docker rootless mode
I'm trying to use rootless docker, but when pulling and image, docker is trying to use zfs as the storage driver. I can confirm that docker info shows the zfs driver. I didn't intend or configure that ...
- 43
0
votes
0
answers
991
views
Slow read speed in ZFS mirror (slower than write speed, and very slow for small chunk sizes)
I have a server running debian on top of a ZFS 3-way mirror of Exos X18 18TB (ST18000NM001J).
I'm benchmarking it and I'm finding some surprises for the read rate under certain conditions.
But first, ...
- 141
0
votes
1
answer
809
views
Can we change the name of rpool?
Can we change the name of rpool? Do we have to create a new BE(Boot Environment)? Can anyone tell me the complete process?
# zpool status
pool: rpool
state: ONLINE
scrub: none requested
config:
...
0
votes
1
answer
191
views
dead ssd drive on zfs points to initramfs
I have an ssd drive with failed controller and which was a part of a mirrored zfs vdev.
Now it boots into initramfs and says that it can't import pool "rpool".
when i issue
zpool import -f ...
- 91
0
votes
1
answer
433
views
How ZFS avoids inodes' number exhaustion and why wasn't it implemented in previous filesystems (e.g. ext4)?
Chapter 1 of Oracle's ZFS Guide states that
all metadata is allocated dynamically, so no need exists to preallocate inodes
which was a positive surprise, but makes me wonder why the methods ZFS uses ...
- 103
0
votes
1
answer
354
views
How to efficiently backup shares (ZFS). Folder structure might change but media usually do not
The Issue: I have 18 large shares (each 24TBs), that contain lots of big media files. Mostly the media files themselves stay untouched. However, sometimes the folder structure changes, and thus my ...
- 1
0
votes
1
answer
186
views
SOLARIS 10 ZFS, I want to add spare with rpool but it gives me this error "cannot label 'c1t4d0': EFI labeled devices are not supported on root pools"
#zpool status
pool: rpool
state: ONLINE
scan: resilvered 8.09G in 0h2m with 0 errors on Wed Sep 21 14:10:40 2022
config:
NAME STATE READ WRITE CKSUM
rpool ...
2
votes
0
answers
140
views
ZFS: Suppressing reservation on receiving side?
I'm trying to incrementally send changes for a zvol from my working pool (zdata) to a backup pool (zbackup), however I'm struggling to suppress the refreservation property.
While I realise that the ...
- 267
1
vote
1
answer
207
views
Recreate Dataset Without Any Data?
I have some datasets that are frequently written to, but whose data is non critical (caches etc.). Is it possible to "send" these to another pool without copying any of their data?
I ...
- 267
0
votes
0
answers
374
views
Unable to remove ZFS cache device created on another operating system
I used to run SmartOS (Solaris) on a server, but recently moved to Proxmox (Linux). A non-root zpool that was exported from SmartOS was successfully imported to Proxmox - except for the cache device (...
- 31
0
votes
0
answers
205
views
ZoL+FIO Randwrite nvme bs=8k@32io = 148MiB/s?
Sorry for the title, but it's very short summary of BS that I'm looking into. Situation
I'm using ZoL 2.1.5 (from jonathonf's ppa) on Ubuntu (tried 20.04&22.04)
I have following NVMe disk
...
0
votes
1
answer
2k
views
How can I list what zfs compression algorithms are available?
I have a zfs pool on a production system and I would like to see if it's possible to use zstd compression instead of the current gzip setting.
Is there any way to list available compression options?
- 51