Stack Exchange Network

Stack Exchange network consists of 175 Q&A communities including Stack Overflow, the largest, most trusted online community for developers to learn, share their knowledge, and build their careers.

Visit Stack Exchange

Questions tagged [zfs]

ZFS is a modern file system and volume manager originally developed by Sun Microsystems and licensed under the CDDL. It is a copy-on-write file system with support for large storage arrays, protection against corruption, snapshots, clones, compression, deduplication and NFSv4 ACLs. An open-source fork of ZFS can be found at http://open-zfs.org/ , which is supported by ZFSonlinux.org, illumos.org and ZFS developers in the FreeBSD & Mac OS X communities.

0
votes
1answer
16 views

Releasing zfs arc memory on FreeBSD

I have a machine running FreeBSD that is subject to a variety of workloads, rabging from Disk intensive to memory intensive. If large amounts of ZFS data are accessed, then the Wired Memory usage can ...
1
vote
2answers
23 views

Always do “zpool export” for easier and/or more reliable recovery?

Setting up a new (zfs-on-linux) setup with a zpool as data storage (not for system) I would like to prepare myself for the worst case as far as possible. But as I do not have any practical ZFS ...
1
vote
0answers
21 views

Bind mount ZFS backed host directory in Docker container

I have Docker 18.06.1-ce running on Ubuntu 18.04. Docker is running on a ext4 file system. I have a raid array for big storage running ZFS. I would like to mount a directory from the ZFS array into a ...
2
votes
0answers
15 views

ZFS pool has one drive mounted twice

My ZFS array is best summed up like this: # zpool status pool: sbn state: ONLINE scan: scrub repaired 8K in 44h43m with 0 errors on Mon Feb 11 21:07:56 2019 config: NAME STATE ...
-2
votes
1answer
33 views

ZFS disk data recovery

I’m new to zfs, so .. I have an HDD, entire disk is zfs. It was created on a FreeBSD machine with zpool create command, and is the only disk in the pool. Data was copied into that pool. I’ve then ...
6
votes
3answers
298 views

Copying terabytes of hundreds of thousands of files in folder slow

I am currently running FreeNAS and using SMB 3 on windows machines to copy folders with 80000+ files that are all about 35MB each. Here is the config FreeNAS 2x40Gbps connections bonded connection ...
0
votes
2answers
73 views

FreeBSD swap usage with mysql

For the past few months, on a few different servers with similar FreeBSD versions and specs, I've been experiencing high swap usage with MySQL while seemingly having plenty of free RAM. FreeBSD 11.2-...
2
votes
2answers
40 views

ZFS performance with databases and more than 80% space used

We have Oracle 11.2 databases on SAN storage (fibre channel on EMC) with Solaris 11.3. For the development environments, the space used on the filesystems is over 80% most of the time. How important ...
4
votes
1answer
104 views

How do I expand the root's volume size?

I have Ubuntu Server 18.04 LTS running off a 16GB SanDisk USB pendrive in my server. From what I can remember, when I installed Ubuntu on there I had enabled LVM support. For some reason, when I ssh ...
1
vote
0answers
15 views

Diagnosize ZFS cache needs

I have a peculiar load on a machine that is limited by disk IO, mostly reads. The bulk of the IO happens on slow network attached disk that are formated with ZFS. Using iostat I can clearly see that ...
2
votes
1answer
49 views

ZFS pool degraded with faulted disk, export and replace not working

I run into troubles after trying to add more disks to my Ubuntu server device. While being a total beginner I powered the server off, added two more disks and restarted the system only to find one of ...
3
votes
1answer
30 views

ZFS - Use a file as l2arc cache

I have a CentOS server that is using zfs to manage a big, slow, network attached volume. We read quite a lot from this volume, hence I would like to optimize the read performances. The idea is ...
0
votes
0answers
24 views

Bandwidth and IO issues when running hardware raid and zfs

I've inherited a setup using Linux Ubuntu 14, a megaraid_sas, and ZFS. We're getting some performance problems (never being able to fully utilize the 6GB bandwidth from the raid) and I'm curious if ...
13
votes
2answers
2k views

How to big scale backup Gitlab?

When asking Gitlab support on how to do a 3TB backup on ones on-premise Gitlab they reply use our tool that produces a tarball. This just seams wrong to me on all levels. This tarball contains the ...
1
vote
1answer
32 views

How to monitor data transfer speed and volume between two computers on same network

My application on Win2012 Server stores its cache on a ZFS appliance in the local network, during peak load we are seeing some performance degradation, this only happens in the production environment ...
0
votes
1answer
28 views

How to remove faulted disk from ZFS pool once spare replacement done

I have a ZFS pool in the current state: [root@zfs01 ~]# zpool status pool: zdata state: DEGRADED status: One or more devices could not be used because the label is missing or invalid. ...
1
vote
1answer
38 views

Lack of TRIM support — will benchmarks get progressively slower on ZFS + SSD?

Context: I'm on a Toshiba 512 GB NVMe (Model: KXG50ZNV512G) I'm seeing this weird behaviour while benchmarking Postgres on ZFS-on-Linux (via pgbench), where the second and third runs of a benchmark ...
3
votes
2answers
230 views

Is ZFS L2ARC required if primary data is already on SSD?

I'm trying to tune ZFS on Linux for my workload (Postgres and a fileserver on the same physical machine [1]), and wanted to understand if I really need L2ARC, or not. If the information given at ...
1
vote
1answer
45 views

ZFS and rsnapshot for backup

I currently run an OwnCloud server with about 25 accounts, 2.6 TB, and moderately growing. As data will be stored for the next several decades, the OwnCloud data is on a mirrored ZFS file system, to ...
4
votes
3answers
135 views

How to limit ZFS writes on NVME SSD in RAID1 to avoid rapid disk wear?

Currently I'm running Proxmox 5.3-7 on ZFS with few idling debian virtual machines. I'm using two SSDPE2MX450G7 NVME drives in RAID 1. After 245 days of running this setup the S.M.A.R.T values are ...
2
votes
0answers
32 views

System freezes when syslog fills up with “java: page allocation failure”

Ubuntu 16.04 x64bit kernel 4.4.0 cpu:8 , memory:31G , ZFS is main filesystem and cifs share is mounted # sudo numactl --hardware available: 1 nodes (0) node 0 cpus: 0 1 2 3 4 5 6 7 node 0 size: 32157 ...
1
vote
1answer
42 views

zfs cache disk for the block device, any performance advantage?

I plan to create ZFS pool with cache option: zpool create .. raidz1 /dev/... cache sdX1 and then ZFS with -V (-V means block device will be created) zfs create -o compression=off -o dedup=off -V 13....
1
vote
1answer
41 views

Replaced a dead disk in a ZFS pool. After resilvering finished, the status look weird :/

I replaced a dead disk in a ZFS pool (on FreeNAS-11.1-U6.3) following the hints I found at Need to replace disk in zpool ... confused ... # zpool replace raid2 gptid/f00-whatever-id-that-was-...
1
vote
1answer
48 views

ZFS zpool create fail because device is part of an active md

I am trying to install ZFS on a new machine that I got. I am new to ZFS, but I have it running on another server, where I have it on a whole disk. On the current machine that I received there is a ...
0
votes
1answer
83 views

FreeNAS too many errors on disk

One disk of my FreeNAS has failed, the zpool only contains a virtual machine. When I call zpool status -v, I get: root@freenas:/ # zpool status -v pool: freenas-boot state: ONLINE scan: scrub ...
0
votes
1answer
66 views

LXD + ZFS on one-disc systems

I'd like to experiment with LXD on a dedicated NUC. Among other options, LXD supports ZFS. But I have the following questions: Case 1: Assume my NUC has one disc, say 256 GB, that supports the OS. ...
4
votes
1answer
110 views

File-sharing over Infiniband on FreeBSD

I have a pair of servers, which I'd like to connect to each other directly -- rather than through the switch shared by the rest of the network. I expect to benefit from lower latency and higher ...
2
votes
1answer
231 views

Increase the ZFS partition to use the entire disk

I have a ZFS pool that currently occupies 100Gb. I increased the disk size to 150Gb, but I can't seem to get the ZFS use the entire disk. I have a the same exact issue yesterday with another server, ...
2
votes
1answer
64 views

Which type of failures I could face with ZFS over multiple RAID-0 drives?

I'm building Proxmox VE on Dell R820, as a Perc H710 card does not support path-through or JBOD modes. I've made a division to enable RAID-0 on 14x 1.0TB SAS drives for zfs storage and RAID-1 of 2x ...
1
vote
1answer
48 views

Formatting/creating file system on multipath volume for ZFS on Linux?

I inherited a ZFS on Linux (CentOS) storage pool and I have a faulty multipath device (mpathah) in my pool: raidz3-6 DEGRADED 0 0 0 ... ... mpathba ONLINE ...
1
vote
1answer
114 views

ZFS not installed into upgraded kernel (4.19)

I want to use the latest kernel (currently 4.19) with Ubuntu Server 18.04, and I also want to use ZFS. Although ZFS appears to install correctly, it apparently does not get installed into the right ...
2
votes
1answer
42 views

Can ZFS mirror a single disk pool automatically? [closed]

I'm getting ready to add another server to my home network. I currently have one storage drive for it. I want to add another one to mirror the first drive, but can't purchase the second drive for a ...
2
votes
2answers
124 views

ZFS dataset doesn't automatically mount

Running on a FreeBSD 12.0 system, a dataset (my home directory) does not mount automatically at system boot. Manually mounting it (i.e. via zfs mount zroot/usr/home/username) works correctly. This ...
1
vote
0answers
147 views

Proxmox: how to access a ZFS volume directly through guest?

That may sound like a strange use case, but is there a way to access a ZFS volume directly through an LXC container or a Qemu VM with Proxmox? I'd like to have incremental backups pushed to my guest ...
4
votes
1answer
140 views

Whats the best filesystem for managing millions of images?

I am designing a system capable of working with 15 million (and growing) image files ranging from 100k to 10mb. I am looking for some opinions on what may be the best filesystem to support the (...
0
votes
0answers
22 views

Mount two HDDs in a zfs pool to new operating system

The SSD containing the OS for my server has just failed. The storage for the server was two 2TB HDDs in a ZFS pool. As far as I know the HDDs are fine and the data intact. What is the easiest way to ...
1
vote
1answer
70 views

How to correctly attach a disk to a zpool to create a mirror? - zpool attach says no such pool or dataset

Yesterday one of my pools which is a mirror was degraded - one of two 2TB disks failed. I replaced the failed one with another disk 4TB (ada3). Now I want to add another 4TB disk (ada1) to enlarge the ...
1
vote
1answer
65 views

FreeBSD/ZFS disk in pool and not in a pool at the same time

I have following status: $ zpool status pool: cs01 state: DEGRADED status: One or more devices has been taken offline by the administrator. Sufficient replicas exist for the pool to ...
0
votes
1answer
109 views

Installing a WD Red NAS drive on a bare metal Freebsd 11.2 machine with ZFS

WD Red NAS drives come with built in firmware (NASware 3.0). If the drive is not going to be used in a conventional NAS device, such as a Synology or FreeNAS machine, are there any special procedures ...
3
votes
1answer
1k views

ZFS test rollback doesn't work as expected

I am confused about how ZFS snapshots and rollback are supposed to work. I have a zpool containing a couple zvols (each made from partitions of a mirrorvdev). I make a snapshot like this: ~$ sudo zfs ...
1
vote
1answer
71 views

ZFS pool size discrepancy after rsync-ing

I am trying to rsync data one of the volumes in a ZFS pool to an exfat formatted drive. The volume is only 1.3 TB but the rsync got up to syncing 3+ TB worth of data. I killed the rsync so I could ...
2
votes
0answers
85 views

ZFS Faulted Pool Corrupted Data, resilver completed, incorrect paths, io error

I recently encountered a disk failure, for which I got a replacement disk, and successfully replaced the disk as well as completed the resilvering process. I was able to use the raidz2 without issues ...
4
votes
1answer
248 views

At my wits end. What could cause my server to randomly hard reset? (Seems to be related to ZFS)

I have a server that I built years ago that has worked like a champ. But within the past few months it has started to become seriously unstable with no discernible pattern. I have been debugging it ...
17
votes
4answers
1k views

If a RAID5 system experiences a URE during rebuild, is all the data lost?

I understand the argument regarding larger drives' increased likelihood of experiencing a URE during a rebuild, however I'm not sure what the actual implications are for this. This answer says that ...
3
votes
1answer
86 views

Why has performance plummeted after destroying and recreating a ZFS pool?

Had to destroy and recreate a pool due to some other issues. I noticed that performance on the new pool is atrocious. Whereas before on the old pool, ARC was full and ARC hits were high, ARC hits on ...
7
votes
1answer
457 views

Offline uncorrectable sectors in SSDs being used for ZFS L2ARC?

I have two enterprise-grade SSDs that I've been using for L2ARC in an OpenZFS pool for a few years. Workflow during this time has been fairly heavy, with lots of reads and writes, serving up video to ...
3
votes
0answers
63 views

Is this disk about to die?

I have a WD Red 4 TB disk (WD40EFRX-68WT0N0, firmware 82.00A82) that is occasionally showing uncorrectable read errors in the SMART error log, e.g.: Error 43 [18] occurred at disk power-on lifetime: ...
4
votes
1answer
118 views

ZFS pool degraded on reboot

I have a Ubuntu server set up with a 14-disk ZFS raidz2 pool. About 80% of the time, on reboot, I will end up with a degraded pool with two of the disks marked as faulted. The drives that are ...
2
votes
2answers
69 views

ZFS replace disks in freebsd, how and when

I have the following zpool configuration: zpool status NAME STATE READ WRITE CKSUM data ONLINE 0 0 0 raidz2-0 ONLINE 0 0 0 da1 ...
1
vote
0answers
51 views

Solaris 11.4, zfs_xcopy parameters

Can anybody explain new parameters appeared in oracle solaris 11.4? zfs_write_throttle_xcopy_scale zfs_xcopy_allowed_pct_over zfs_xcopy_bloom_entries zfs_xcopy_hard_limit_factor ...