Questions tagged [ext4]

The ext4 or fourth extended filesystem is a journaling file system for linux/*nix developed as the successor to ext3.

Filter by
Sorted by
Tagged with
1
vote
0answers
91 views

Slow disk resize during boot on VMs with Debian 10 Buster images on GCP

resize2fs takes extra 90 seconds to resize 2TB boot disk during boot on Debian 10 than on Debian 9. Note that time to create/provision VM instance (gcloud compute instances create ...) is the same (...
1
vote
1answer
49 views

Can't write on Samba4 share using Zentyal 6.1 server, after upgrading from 5, read only is allowed

I can't write on all my clients (Windows 7 and Windows 10) in all my samba shares, even if the users are accepted on domain, and the permissions was maintained. The shares are on a NAS, ISCSI ...
1
vote
0answers
39 views

Physical Volume Actual Utilization for replacement

I have a Volume Group which consist two physical volume of size 10TB each SSD & NLSAS (yes one very slow and other very fast) so total 20TB. I created Volume backupvg with the 10TB SSD & ...
2
votes
3answers
127 views

Linus/ext4/nvme crashes during high io

During mvn compilation, I have random crashes. The problem seems related to high IO and in kern.log, I can see things like: kernel: [158430.895045] nvme nvme1: controller is down; will reset: CSTS=...
0
votes
0answers
35 views

File timestamps precision - ext3 with nanoseconds, ext4 with milliseconds

It is said that ext3 supports file timestamp precision up to seconds and ext4 up to nanoseconds... What happens is that my old VPS running Ubuntu 12.04 with a ext3 filesystem always (as far as I can ...
0
votes
0answers
16 views

kickstart config for metadata_csum in ext4

will my kickstart file not install ext4 FS without metadata_csum option ? partition / --onpart=hda1 --grow --fstype=ext4 --mkfsoptions="-O ^metadata_csum"
0
votes
1answer
167 views

How to mount a LVM controlled ext4 file system stored on a AWS EBS volume built from a snapshot

I have a ext4 file system that is part of a Logical Volume and the underlying storage is AWS EBS. I took a snapshot of the EBS and then used that to create a new EBS volume and attached it to theEC2 ...
25
votes
5answers
15k views

Ext4 vs. XFS vs. Btrfs vs. ZFS for NAS [closed]

My use case: I have Ubuntu Server 18.04 installed on an M.2 SSD. I have a 4TB HDD I want to add as storage. Since it's mostly for large media files and backups, it won't be written to very often. ...
1
vote
1answer
121 views

SQLite WAL concurrent write performance on UNIX systems

I have two setups: one runs on windows 10 (ntfs partition), the other on debian (ext4 partition). The R source code is the same. The main process starts 8 child-processes (P-SOCKS) -- on 8 vcores -- ...
0
votes
0answers
17 views

qemu-kfm LVM logical volume size inconsistency in df output

The Problem: andi@docker-host-01:~$ df -hT . Filesystem Type Size Used Avail Use% Mounted on /dev/vdb1 ext4 79G 41G 35G 55% / Adding 41G & 35G gives 76G and not 79G as shown ...
1
vote
2answers
122 views

Recover MySQL tables from removed Proxmox VM

Have the stand-alone Proxmox node with LVM thin and VM 130 volume /dev/pve/vm-130-disk-0 inside it. VM 130 was deleted accidentally. Mysql database was lost with VM. After we've discovered it in a day,...
0
votes
0answers
13 views

How to use Data Blocks for building an Extent Tree?

I am building an extent-based File System for a school project. I wanted to use an ext4-like design with its Extent Trees, but I don't understand how exactly the Extent Trees are built. As far as I ...
1
vote
0answers
153 views

I've killed the processes that held the deleted files, but a filesystem is still full

I have a host that runs CentOS-6 with Linux 2.6.32-696.18.7.el6.x86_64 (yes, pretty old) and I ran out of disk space on the root filesystem. The filesystem's size is 16G, du shows about 3G being used ...
0
votes
1answer
365 views

Why I cant read/mount on macosx external disk formatted extfat?

I have connected via USB this SATA disk previously mounted on a Linux system in a RAID 1 HW configuration: I have installed ext4fuse to mount the FS. First of all I checked the drive with: ...
1
vote
1answer
86 views

ext4 raid5 corrupt group descriptor

I have a raid5 NAS on Open Media Vault, with 3x 2To disks. A few days ago I've inserted a spare disk from another raid. I did not see it at the beginning, but I think that changed disks order. Then I ...
0
votes
0answers
38 views

is it right to mix diff file system between kafka machines

we have kafka cluster with 3 machines each kafka machine use disk for DATA , and each disk is 20TB size the file system on the disk is ext4 now we want to add additional 5 kafka machines but to ...
0
votes
0answers
98 views

Millions of “shrink_slab: ext4_es_scan+0x0/0x130 [ext4] negative objects to delete nr=-2147483358”

On two machines we have a reoccurring problem where the root filesystem gets 100% full because of /var/log/messages filling up with millions of messages as shown below. We have many other machines ...
0
votes
1answer
40 views

Run similar disk intensive tasks parallel or serial on regular Linux?

Scenario I'm on a regular Ubuntu 18.04 LTS with ext4 Filesystems. I'm using restic to backup my machines. Restic is a backup tool that support different backends (local, sftp, aws, gcs, ..) but only ...
0
votes
0answers
54 views

Any benefits of ZFS over EXT4 for data stream processing on top of HDFS?

I'm working on a data stream processing project in which i will be using Apache Flink and Apache Spark and I want to use HDFS for storage. The development and testing will be done on a single node ...
0
votes
0answers
57 views

Save data from a corrupted file system with SCP

An instance I manage recently experienced file system block errors and passed in Read Only mode. Before any attempt to fix it, I wanted to save one specific docker volume. scp -r -v user@some_domain:...
1
vote
1answer
388 views

Best block size for fio when reading a file

To pre-warm an ext4 EBS volume I'm using fio as follows: fio --name <filename> --filename <filename> --rw read --direct 1 --ioengine libaio --bs <X>k and I'm trying to understand ...
4
votes
3answers
514 views

How to write a sparse Linux (EXT4) disk image without writing gigabytes of zeros?

I have a 64 GB Linux disk image with ~50 GB of unused space across the partitions. The file is sparse, so it only takes ~14 GB on disk. But if I dd the image, it writes the full 64 GB, which takes ...
1
vote
7answers
356 views

Print unused bytes of logical volume

Imagine the physical volume was resize with: pvresize /dev/sda2 And the logical volumne was resized with: lvresize -l +100%FREE system/home But this command was not done: resize2fs /dev/mapper/...
0
votes
0answers
49 views

ext4 defrag free space - move files to start of the part

I have some big VMs CENTOS6 with LVM and EXT4 FS. I'm using space reclamation in ESXi, but I have very small efficiency. In my research I know that this is probably because free space fragmation. My ...
0
votes
0answers
125 views

Designing a performing iSCSI KVM storage stack

I had some performance issues with iSCSI in a production setup I was unable to debug (due to the production nature) and I'm trying to recreate setup to test, benchmark and eventually replace the prior ...
0
votes
1answer
155 views

EXT4 filesystem data loss running Debian 9 under KVM

I'm trying to setup KVM virtualization on a CentOS 7.6.1810 host. This is a machine with a Xeon E-2176G CPU and a double 1 TB SSD drive. The SSDs are configured as software raid. Personalities : [...
0
votes
1answer
946 views

Bad magic number in super-block : Red Hat 6

I extended a disk on RHEL 6.9. I am getting superblock error when running resize2fs on the new disk. This was the previous filesystem layout before resizing: Disk /dev/sdc: 289.9 GB, 289910292480 ...
0
votes
1answer
32 views

Where are files on the disk when using ext4?

For a job, I have to wipe a lot of disks that contain sensitive information. Those disks are all identical, I cannot wipe more than one at the same time, and fully wiping one takes me a full hour. To ...
1
vote
1answer
206 views

output of cat /proc/sys/fs/inode-nr vs df -i

What's the difference between the output of cat /proc/sys/fs/inode-nr and df -i Both are documented at returning the number of inodes in use, but they return apparently unrelated numbers. $ df -...
2
votes
1answer
99 views

Diagnosing missing logical volume

EDIT: the system boots off a 16 gigabyte USB key. Apparently, at some point, the 'device name' (sorry if I'm using that term incorrectly) of the boot device changed.from /dev/sde to /dev/sdb to /dev/...
-3
votes
2answers
81 views

Huge data loss in RAID 1 array [closed]

I've recently faced a huge data loss (everything from last 5 months) after one of my disk crashed, even if the RAID array is still fine. This disk was a SSD with my root partition (ext4), mirrored in ...
-1
votes
1answer
1k views

formatting External HDD gets stuck

I have an external 2TB HDD that i plan on leaving attached to my ubuntu server. I am trying to format it to ext4 but am encounterin issue My current setup is a 200gb ssd in the server (sdb), 2x2TB ...
3
votes
1answer
247 views

EXT4 : journaling or not for embedded Nand

We've developed an app for embedded Linux clients (similar to raspberry Pi) and we are using 64 GB MLC Nand for storage. On our tests devices we see significant failure rate of 1/3 approximately. The ...
0
votes
2answers
103 views

Give permission to folder and subfolders to multiple users with ability to overwrite files

I know the question is pretty common, but I not seems to find good answer. Setup is following - there is webserver and there is a folder where Apache (user www-data) create directories and upload / ...
0
votes
0answers
39 views

Best practices for filesystem stored in a file

For GDPR purposes, I will need to setup encrypted filesystem on my server. My server comes with single partition formatted as XFS - this is stock I can not change this. I plan to do big file 1TB or ...
1
vote
1answer
221 views

Hard drive with many hard links 'fills' almost overnight

I recently installed a cheap 2tb hard drive on a server for backing up files which are also backed up elsewhere. It's basically an overflow drive. The other drives on the server are configured as 1TB ...
2
votes
1answer
546 views

Why is UUID missing after creating ext4 filesystem on RHEL7 ec2 instance

I'm using Ansible to configure a server. This server is running on AWS Ec2 and I'm attaching to it four EBS drives. When I run my ansible playbook it will fail about 50% of the time. The failure is ...
3
votes
2answers
2k views

mkfs -O ^64bit,^metadata_csum -t ext4 in 2019

Thomas Krenn recommends creating ext4 partitions like: https://www.thomas-krenn.com/de/wiki/FSCK_Best_Practices mkfs -O ^64bit,^metadata_csum -t ext4 what does this mean? does this have anything ...
2
votes
1answer
396 views

quotacheck: Cannot stat() given mountpoint –cugv: No such file or directory

I am trying to enable quotas on an ext4 partition of a Debian 9 VM. The partition is mounted on /public with the usrquota,grpquota options. The machine has been rebooted. Here is what happens: root@...
10
votes
5answers
1k views

Options for performance improvements on very big Filesystems and high IOWAIT

I have a Ubuntu 16.04 Backup Server with 8x10TB HDD via a SATA 3.0 Backplane. The 8 Harddisks are assembled to a RAID6, an EXT4 Filesystem is in use. This Filesystem stores a huge amount of small ...
0
votes
2answers
202 views

Copy LVM Volume Group to a new single hard disk

I have a headless Ubuntu (18.04) server with 3 hard drives each partitioned to a single lvm volume group for a combined size of 6Tb. I recently purchased a new hard drive that is 8Tb and I want to get ...
0
votes
1answer
194 views

ext4 mysterious “No space left on device” error

Im having trouble with my ext4 filesystem. Im using this with NFS to make it available to remote machines. Now its showing a mysterious "No space left on device" error when im trying to mkdir $name ...
2
votes
1answer
441 views

how to get kubernetes to mount ext4 volumes over iscsi in journaled mode instead of ordered

I'm running kubernetes on Ubuntu 18.04.1, running some of my pods with mounts via ISCSI. I've noticed recently (maybe due to improperly unmounting the iscsi volume or for other reasons) that at ...
0
votes
1answer
7k views

How to recover an ext4 signature deleted with fdisk?

While resizing an EBS volume on Amazon AWS I accidentally deleted the ext4 signature. root@server:~# fdisk /dev/xvdf Welcome to fdisk (util-linux 2.31.1). Changes will remain in memory only, until ...
2
votes
2answers
2k views

Centos 7 - fstab does not mount some partitions, but mount /dev/sd* does

i have a Virtual Machine with Centos 7, on which i want to mount some ext4 partitions. Physical disks are actually hard disks provided by vSphere. All disks are located on the same NAS - so the three ...
2
votes
1answer
1k views

Make Ubuntu Server use less swap and more actual RAM

I have a server with 128 GB of RAM and a 100 GB hard drive in it. It seems to use pretty much swap instead of using actual RAM when rsyncing disks. I found other questions on Stack Overflow with ...
1
vote
1answer
93 views

KVM: Is it possible to detect guest disk was mounted RW?

Let's assume I have a KVM-based virtual machine. There is a volume that contains the operating system and the data. I know it is possible to access from host at least READ-ONLY the filesystem which ...
2
votes
1answer
195 views

Uneven disk load with mdadm RAID5 and ext4 filesystem with journal

Recently I created a RAID5 with mdadm: mdadm --create /dev/md0 -l 5 -n 4 -c 512 /dev/sdb /dev/sdc /dev/sdd /dev/sde The usual tuning to speed up the initial sync: echo 32768 > /sys/block/md0/md/...
0
votes
1answer
1k views

How to delete files after EXT4-fs error: Directory hole found

I have a specific directory where I am unable to delete the files or the directory. The directory is on an ext4 file system, using RAID5 over 3 disks on a QNAP NAS. Using rm -f gives me: rm: unable ...
0
votes
2answers
858 views

Partitioning - Is 5% reserved blocks required/recommended?

I'm performing a new Ubuntu Server installation, on hardware RAID 10, 6 x 1.72TB SSD, total space to partition is 5.8TB. The server is going to be used for KVM virtualisation. I've allocated 500MB ...

1
2 3 4 5
9