Questions tagged [ext4]
The ext4 or fourth extended filesystem is a journaling file system for linux/*nix developed as the successor to ext3.
458
questions
0
votes
0
answers
18
views
What are the differences between these ext4 features: dir_nlink vs large_dir
From the ext4(5) man page:
dir_nlink
Normally, ext4 allows an inode to have no more than 65,000 hard links. This applies to regular files as well as directories, which means that there can be no more ...
0
votes
0
answers
77
views
Upgrade to KeyCloak 18 fails
I have a KeyCloak 17.0.1 that is apparently working without issues on my server, configured to use MariaDB. I say "apparently" because, as of today, it's not in production yet, albeit it ...
- 310
0
votes
1
answer
62
views
Wrong ext4 filesystem free space
We have a linux server with LVM. Looking the space availability with df -h the difference between filesystem size and used space is not zero but the available space is zero.
This is the output of the ...
- 1
8
votes
1
answer
751
views
Linux/ext4/sqlite: Can touching a file while it's being written to cause a race condition?
For context: I need to be able to reliably update the timestamp on some sqlite DB files which get intermittent updates on an ext4 filesystem.
Can using the touch command (to update the last ...
- 1,183
1
vote
0
answers
11
views
Block device suddenly full; can't identify a single file as culprit and SMART shows no drive errors [duplicate]
Setup
Ubuntu 20.04
Dell PowerEdge R820
[PERC H710] 2x Virtual Drives (RAID-1 Boot, RAID-0 Work Drive)
Everything been fine for 6 months
No preceeding even, just suddenly, drive full.
Details...
This ...
- 333
0
votes
1
answer
235
views
mkfs.ext4 -m -T options
How can I find out if I formatted the drive with
mkfs.ext4 -m 0 -T largefile4
or without specifying the options -m and -T
mkfs.ext4
In other words how can I see what is the -m reserved-blocks-...
0
votes
0
answers
34
views
File system to maximize utilizable space on a drive
I'm trying to fit as many 108 GB files on a 16 TB as possible. If I format the drive for ext4 with default options I can fit 138 files on it.
But if I do
mkfs.ext4 -m 0 -T largefile4 /dev/xxx
146 ...
0
votes
1
answer
69
views
Ways to debug root partition not unmounted on reboot
I have a problem where every time I reboot a Linux system (Ubuntu-based), the root filesystem is not unmounted successfully.
Doing a fsck after a reboot results in output like:
Recovering journal [...]...
- 101
0
votes
0
answers
16
views
How to install Xenserver Properly
When I installed xenserver 7, It asked me if I want thick or thin provisioning. Thinking this is a production server I must have chosen EXT because I had problems with LVM before with balooning of ...
1
vote
1
answer
106
views
Fragmented directory on ext4?
My ext4 filesystem loses performance when growing.
I have a system storing a lot of image files. This Debian based image server stores image files divided in year folders on 1-2TB disk sets with ...
- 31
3
votes
1
answer
803
views
Why can I change the the reserved blocks on a read only mounted ext4 filesystem?
I would have expected an error, sorry FS is read-only, but it is possible. This is unexpected & counter intuitive is there a reason?
Linux files 5.11.0-27-generic #29~20.04.1-Ubuntu SMP Wed Aug 11 ...
- 39
0
votes
0
answers
330
views
Recovering a file by mounting a Synology RAID1 disk in Ubuntu (mount, mdadm, and losetup issues)
I'm working with a Synology RAID1 system and deleted a file that wasn't yet backed up. To recover the file, and since an undelete approach seems to be impossible, my idea is to mount a single RAID1 ...
- 101
3
votes
0
answers
3k
views
Mount filesystem with "structure needs cleaning" on ext4
There is a created years ago(and many time resized from that times) filesystem with ext4. After power failure it stop to mount.
When i try to mount it manually i receive an error:
# mount /dev/space/...
- 909
0
votes
0
answers
256
views
mkfs + any solution for “could not read block” or disk replacing
we doing mkfs on the disk sda as the following
mkfs.ext4 -j -m 0 /dev/sda -F
mke2fs 1.42.9 (28-Dec-2013)
Warning: could not erase sector 2: Attempt to write block to filesystem resulted in short ...
- 399
3
votes
1
answer
251
views
e2fsck cleans a filesystem and then a few minutes later (after a lot of reads) there are errors
The filesystem is on an LVM RAID5. It appears to be working correctly:
$ sudo pvs
[sudo] password for jrwren:
PV VG Fmt Attr PSize PFree
/dev/sda2 datavg lvm2 a-- <7.28t ...
- 370
0
votes
0
answers
179
views
How many reserved blocks are needed to avoid ext4 filesystem fragmentation?
On a typical ext4 filesystem, 5% of blocks can only be allocated by privileged processes. According to the manpage of tune2fs:
Reserving some number of filesystem blocks for use by privileged ...
- 1,680
1
vote
0
answers
135
views
What linux distro support Host Managed HDD by file system?
According to this Seagate presentation there are some ongoing (?) efforts targeted toward modification of ext4 file system introducing SMRFS -EXT4 - support of host managed hard drives. The goal is to ...
- 111
5
votes
1
answer
167
views
Are my drives being utilized equally with Linux Software RAID 0 array?
I have four NVMe drives in a RAID 0 configuration.
I am attempting to determine how many IOPS the array is handling.
When I run iostat, it appears that one drive is handling more IO than the other ...
0
votes
1
answer
116
views
Using nobarrier with ext4 and google persisten disks
I was looking into speeding up some heavy DB write workload on google cloud vm. I saw nobarrier option for ext4 FS can provide some performance boost. I was wondering if anyone knows if it is safe to ...
google-cloud-platform
0
votes
1
answer
107
views
directory listing hangs after directory was flooded with > 5 million files
A misconfigured logrotate produced a lot of files in a directory on my server. ls | wc -l showed 5,387,172 files and according to du -sh this summed up to about 8 GB. dmesg showed many errors like ...
- 177
0
votes
1
answer
660
views
Force all files & subdirs that BY ANY MEANS come to be in/under a directory to inherit all permissions and group
I know this question may appear to be a duplicate, because many people have asked related questions about permission inheritance. However, none of the answers I've found address the full scope of what ...
- 101
1
vote
2
answers
450
views
Ext4 metadata checksums: current feature status
The kernel wiki page for ext4 metadata checksums is marked "last modified on 22 October 2013". I couldn't find more recent status information on this feature, except for this question from ...
- 113
1
vote
0
answers
239
views
Convert ext4/xfs file system to btrfs with minimal application impact
I'm trying to find a way to convert the file system of app servers (some of which run ext4 and some xfs) to btrfs. Preferably, I'd like to do this without needing to turn off the services.
So far I've ...
- 11
1
vote
1
answer
1k
views
When enabling ext4 large_dir, how can you tell it's used?
Problem: after enabling the ext4 large_dir option I want to know if it's used and/or whether I need to recreate directories for it to be used.
Detail: I have directories that on occasion can hold ...
- 7,781
1
vote
0
answers
25
views
ext4 restore backup: deleteino: out of range 0
I'm trying to use (dump) restore -command to restore linux ext4 file system from an incremental backup. I'm using a hanoi tower strategy to make the backups, and the dumps look like as follows, sorted ...
- 161
3
votes
1
answer
2k
views
Cheap/fast deduplication with hardlinks?
I've got shared hosting with a few thousand Wordpress installs and I've wanted for ages to have a nice way of removing all the duplicate files in a sensible and secure way.
I'm looking for better disk ...
- 287
3
votes
1
answer
666
views
mkfs.ext4 error with option -O ^64bit
When I run /sbin/mkfs.ext4 -O ^64bit /dev/app/mysqldata command in a script it gives me below error:
nd(): null: With return code "1", Output from: "/sbin/mkfs.ext4 -O ^64bit /dev/app/...
- 43
2
votes
1
answer
194
views
fsck raid10 ext4 partition currupted, restore data
there is a volume in raid10 /dev/md3
it has a GPT partition /dev/md3p1 in ext4 with a size of 16TB.
I accidentally ran
fsck -y /dev/md3
causing the filesystem in /dev/md3p1 to get corrupted.
fsck -b ...
- 23
0
votes
1
answer
110
views
between ex4 and XFS which is better for large small files [closed]
Between EXT4 and XFS which file system is better when an application uses multiple threads to read/write large amount of small files on a SSD.
From what I read
In general, Ext3 or Ext4 is better if ...
- 379
0
votes
4
answers
629
views
What is the purpose of having a "/" and a "/home" partition in linux?
I'm doing a clean install of CentOS 8 minimal, and by default it suggests these paritions:
swap swap 4G
/boot ext3 512M
/ ext4 2014G
/home ext4 all
(this is with a pair of 4TB NVMe drives in ...
- 1,034
2
votes
0
answers
528
views
Interpreting resize2fs shrink progress (-p) "pass 2" output
The question: What is resize2fs's progress bar indicating during "pass 2" of an offline shrink operation on a large (8-28Tb) ext4 filesystem?
The details:
I've done ~5 resize2fs shrink ...
- 151
0
votes
1
answer
40
views
weird filesystem behavior (corruption?)
Something very weird I came across, any thoughts would be much appreciated:
Some software (httrack) created a directory structure. Using my user (which also ran the software), I cannot view the ...
- 5,929
0
votes
2
answers
316
views
Monitor Linux Server filesystem health and suspicious activities
I run my own, small server here. The server runs on Ubuntu 18.04. There is one single HDD using LVM on a partition together with EXT4. LVM is used for taking snapshots. I also use Webmin with ...
- 101
0
votes
0
answers
255
views
mdadm RAID 10 filesystem corruption -- recoverable?
PROBLEM: I had a degraded disk in my RAID 10 array which I created using mdadm. I first removed the disk, replaced it with a new one, but when I rebuilt, I got an error saying it couldn't detect the ...
0
votes
0
answers
103
views
Linux ext4 incremental backup tool produces individual files not one
I want to backup ext4 files with size (<100MB) as they are, NOT in one single archive file (like with dump or tar).
Can you recommend me a tool that keeps the directories/files structure in the ...
0
votes
3
answers
162
views
We are migrating our wordpress to static site. That is creating over 400,000 folders within 1 folder. Is there any limit to the number of sub-folders?
Our wordpress web site is several years old and has many posts indexed and ranking well on google. With any serious traffic my wordpress server tanks - and this happens even after several rounds of ...
3
votes
1
answer
2k
views
Reason for EXT4 file system corruption of Hyper-V guest
We had our second corruption of an ext4 partition in a relatively short time and ext4 is supposedly very reliable. As this is a virtual machine and the host providing the resources saw no disk errors ...
- 145
5
votes
2
answers
2k
views
Estimating the time needed for a resize2fs shrink
I have a large ext4 filesystem which I'm currently shrinking (109Tb -> 83Tb in my case), and it's taking an extremely long time (Day 5 as of asking). Currently I can see that the process is still ...
- 163
1
vote
1
answer
322
views
Slow disk resize during boot on VMs with Debian 10 Buster images on GCP
resize2fs takes extra 90 seconds to resize 2TB boot disk during boot on Debian 10 than on Debian 9.
Note that time to create/provision VM instance (gcloud compute instances create ...) is the same (...
1
vote
1
answer
161
views
Can't write on Samba4 share using Zentyal 6.1 server, after upgrading from 5, read only is allowed
I can't write on all my clients (Windows 7 and Windows 10) in all my samba shares, even if the users are accepted on domain, and the permissions was maintained. The shares are on a NAS, ISCSI ...
- 33
1
vote
0
answers
50
views
Physical Volume Actual Utilization for replacement
I have a Volume Group which consist two physical volume of size 10TB each SSD & NLSAS (yes one very slow and other very fast) so total 20TB.
I created Volume backupvg with the 10TB SSD & ...
- 11
3
votes
5
answers
2k
views
Linus/ext4/nvme crashes during high io
During mvn compilation, I have random crashes.
The problem seems related to high IO and in kern.log, I can see things like:
kernel: [158430.895045] nvme nvme1: controller is down; will reset: CSTS=...
- 151
0
votes
1
answer
1k
views
How to mount a LVM controlled ext4 file system stored on a AWS EBS volume built from a snapshot
I have a ext4 file system that is part of a Logical Volume and the underlying storage is AWS EBS. I took a snapshot of the EBS and then used that to create a new EBS volume and attached it to theEC2 ...
- 121
42
votes
5
answers
60k
views
Ext4 vs. XFS vs. Btrfs vs. ZFS for NAS [closed]
My use case: I have Ubuntu Server 18.04 installed on an M.2 SSD. I have a 4TB HDD I want to add as storage. Since it's mostly for large media files and backups, it won't be written to very often.
...
- 529
1
vote
1
answer
371
views
SQLite WAL concurrent write performance on UNIX systems
I have two setups: one runs on windows 10 (ntfs partition), the other on debian (ext4 partition). The R source code is the same. The main process starts 8 child-processes (P-SOCKS) -- on 8 vcores -- ...
- 125
1
vote
2
answers
233
views
Recover MySQL tables from removed Proxmox VM
Have the stand-alone Proxmox node with LVM thin and VM 130 volume /dev/pve/vm-130-disk-0 inside it.
VM 130 was deleted accidentally.
Mysql database was lost with VM.
After we've discovered it in a day,...
- 33
1
vote
0
answers
873
views
I've killed the processes that held the deleted files, but a filesystem is still full
I have a host that runs CentOS-6 with Linux 2.6.32-696.18.7.el6.x86_64 (yes, pretty old) and I ran out of disk space on the root filesystem.
The filesystem's size is 16G, du shows about 3G being used ...
- 527
0
votes
1
answer
1k
views
Why I cant read/mount on macosx external disk formatted extfat?
I have connected via USB this SATA disk previously mounted on a Linux system in a RAID 1 HW configuration:
I have installed ext4fuse to mount the FS.
First of all I checked the drive with:
...
- 101
1
vote
1
answer
355
views
ext4 raid5 corrupt group descriptor
I have a raid5 NAS on Open Media Vault, with 3x 2To disks.
A few days ago I've inserted a spare disk from another raid.
I did not see it at the beginning, but I think that changed disks order.
Then I ...
- 135
0
votes
1
answer
76
views
Run similar disk intensive tasks parallel or serial on regular Linux?
Scenario
I'm on a regular Ubuntu 18.04 LTS with ext4 Filesystems.
I'm using restic to backup my machines. Restic is a backup tool that support different backends (local, sftp, aws, gcs, ..) but only ...
- 285