Questions tagged [ext4]
The ext4 or fourth extended filesystem is a journaling file system for linux/*nix developed as the successor to ext3.
470
questions
0
votes
0
answers
10
views
Rclone to a SFTP endpoint in a local network with a bunch of disks - suggested disks setup?
I have a need to copy a complex dataset (around 4 PB total, hundreds of millions of files) via Rclone copy, for some customers (each of them own around 100TB out of the 6PB) - to a bunch of disks via ...
- 65
2
votes
1
answer
38
views
How to Root volume partition without losing the data
We have this scenario : I to increase the disk space of one of our VM,
Disk details :
root@Test-01:~# blkid
/dev/vda2: UUID="0eae0eb4-92ed-45ec-aa99-6d606f17e70a" TYPE="swap" ...
- 49
2
votes
1
answer
124
views
Extremely slow MySQL writes in Ubuntu (ext4) guest on Promox 7.3-3 (ZFS) host
I'm trying out Proxmox 7.3-3 as a hypervisor and managed to install it using ZFS on my NVMe (Samsung_SSD_970_EVO_Plus_2TB_S6S2NS0T505403V)
I also installed a Ubuntu 22.04 VM and its filesystem is ext4
...
- 155
0
votes
0
answers
31
views
RHEL + what could be the reason that FSTYPE not defined from lablk , in spite filesystem was created on disk in the past
I want to share the following very strange behavior , that for me it's not make sense but its a a fact on our production RHEL 7.2 server
disks are VMDK
from df -h we can see the following:
sdb ...
- 479
0
votes
1
answer
144
views
"rsync: [generator] mknod … failed: File name too long (36)" though file & path name lengths are way shorter than 255 & 4096
On a QNAP NAS I'm trying to copy a huge backup directory from internal to an USB disk. The backup set was created using back-in-time, therefore it uses hard-links for deduplication and encfs generated ...
- 141
0
votes
0
answers
52
views
CIFS corrupts ext4 FS inside an image mounted on loop
I have a CIFS volume which contains an image file formatted with ext4 and mounted on loop. Sometimes the ext4 FS corrupt itself and the following lines shows in the logs:
Jan 30 04:00:02 server1 ...
- 1
0
votes
1
answer
44
views
rm -rf on some direcories never complete
I have several directories in an ext4 filesystem that I can't delete. When I run rm -rf on the directories ps aux | grep rm shows a status of D for the process. I have tried allowing it to run for ...
- 861
0
votes
0
answers
183
views
mdadm RAID5 mismatch, which file(s) on ext4 filesystem are affected?
After a scrub of my 4-disk RAID5 mdadm array I got these log entries:
Dec 03 07:20:53 srv10 kernel: md1: mismatch sector in range 204340608-204340616
Dec 03 07:20:53 srv10 kernel: md1: mismatch sector ...
- 354
0
votes
1
answer
70
views
Linux: 1 TB HDD showing 7 TB partition!
I replaced a 1 TB HDD (which holds a single EXT4 partition with lots of hardlinks to backup files/directories also inside this partition. It has also a bunch of regular files/directories) with a 2 TB ...
- 133
1
vote
0
answers
87
views
How do you Defrag an XFS file system
My old workstation, has /var /usr and /home mounted on an xfs file system, and it seems to spend most of its time grinding away, and getting slower and slower, much like windows used to 20 years ago, ...
- 361
0
votes
0
answers
128
views
resize2fs -M doesn't remove all (most) free blocks
I'm trying to create a smaller version of a Rasbian OS Lite image. I have tried to run resize2fs -M /dev/sda2 on the SD card root partition.
But as you can see below, after resize2fs there is still a ...
- 101
1
vote
0
answers
193
views
Extreme performance degradation with ext4 barriers
I'm getting very low performance with ext4 barriers enabled (the default):
sysbench gives me with barriers on:
File operations:
reads/s: 55.03
writes/s: ...
- 1,035
0
votes
0
answers
33
views
Discover EXT4 (or other) Linux file system (e.g. bootable?)
I want to be able to identify whether some older SATA HDD's have Linux partitions. With the advent (and my fairly recent discovery) of Windows Subsystem for Linux (WSL) on Windows, I realize options ...
- 1
0
votes
0
answers
600
views
How to recover file system (ext4) on raid5?
I have an ext4 file system on a raid5 array, /dev/md0 built from mdadm.
I found it wasn't mounted after I reboot once. And I ran a fcsk on it but get a superblock error.
So I was going to run mke2fs -...
- 101
0
votes
0
answers
66
views
disk quota (using quota tools) of type "project" with an hard limit for root
I have a program that must run as root. I want to limit its disk usage by using quotas. I set up a project quota on the directory that said program uses for storage. It looks like that disk quota ...
0
votes
0
answers
553
views
Upgrade to KeyCloak 18 fails
I have a KeyCloak 17.0.1 that is apparently working without issues on my server, configured to use MariaDB. I say "apparently" because, as of today, it's not in production yet, albeit it ...
- 380
0
votes
1
answer
348
views
Wrong ext4 filesystem free space
We have a linux server with LVM. Looking the space availability with df -h the difference between filesystem size and used space is not zero but the available space is zero.
This is the output of the ...
- 1
8
votes
1
answer
885
views
Linux/ext4/sqlite: Can touching a file while it's being written to cause a race condition?
For context: I need to be able to reliably update the timestamp on some sqlite DB files which get intermittent updates on an ext4 filesystem.
Can using the touch command (to update the last ...
- 1,203
1
vote
0
answers
11
views
Block device suddenly full; can't identify a single file as culprit and SMART shows no drive errors [duplicate]
Setup
Ubuntu 20.04
Dell PowerEdge R820
[PERC H710] 2x Virtual Drives (RAID-1 Boot, RAID-0 Work Drive)
Everything been fine for 6 months
No preceeding even, just suddenly, drive full.
Details...
This ...
- 333
0
votes
1
answer
750
views
mkfs.ext4 -m -T options
How can I find out if I formatted the drive with
mkfs.ext4 -m 0 -T largefile4
or without specifying the options -m and -T
mkfs.ext4
In other words how can I see what is the -m reserved-blocks-...
0
votes
1
answer
181
views
Ways to debug root partition not unmounted on reboot
I have a problem where every time I reboot a Linux system (Ubuntu-based), the root filesystem is not unmounted successfully.
Doing a fsck after a reboot results in output like:
Recovering journal [...]...
- 101
1
vote
1
answer
375
views
Fragmented directory on ext4?
My ext4 filesystem loses performance when growing.
I have a system storing a lot of image files. This Debian based image server stores image files divided in year folders on 1-2TB disk sets with ...
- 31
3
votes
1
answer
948
views
Why can I change the the reserved blocks on a read only mounted ext4 filesystem?
I would have expected an error, sorry FS is read-only, but it is possible. This is unexpected & counter intuitive is there a reason?
Linux files 5.11.0-27-generic #29~20.04.1-Ubuntu SMP Wed Aug 11 ...
- 39
0
votes
0
answers
2k
views
Recovering a file by mounting a Synology RAID1 disk in Ubuntu (mount, mdadm, and losetup issues)
I'm working with a Synology RAID1 system and deleted a file that wasn't yet backed up. To recover the file, and since an undelete approach seems to be impossible, my idea is to mount a single RAID1 ...
- 101
5
votes
0
answers
9k
views
Mount filesystem with "structure needs cleaning" on ext4
There is a created years ago(and many time resized from that times) filesystem with ext4. After power failure it stop to mount.
When i try to mount it manually i receive an error:
# mount /dev/space/...
- 1,046
0
votes
0
answers
691
views
mkfs + any solution for “could not read block” or disk replacing
we doing mkfs on the disk sda as the following
mkfs.ext4 -j -m 0 /dev/sda -F
mke2fs 1.42.9 (28-Dec-2013)
Warning: could not erase sector 2: Attempt to write block to filesystem resulted in short ...
- 479
3
votes
1
answer
976
views
e2fsck cleans a filesystem and then a few minutes later (after a lot of reads) there are errors
The filesystem is on an LVM RAID5. It appears to be working correctly:
$ sudo pvs
[sudo] password for jrwren:
PV VG Fmt Attr PSize PFree
/dev/sda2 datavg lvm2 a-- <7.28t ...
- 370
3
votes
0
answers
408
views
What linux distro support Host Managed HDD by file system?
According to this Seagate presentation there are some ongoing (?) efforts targeted toward modification of ext4 file system introducing SMRFS -EXT4 - support of host managed hard drives. The goal is to ...
- 131
5
votes
1
answer
416
views
Are my drives being utilized equally with Linux Software RAID 0 array?
I have four NVMe drives in a RAID 0 configuration.
I am attempting to determine how many IOPS the array is handling.
When I run iostat, it appears that one drive is handling more IO than the other ...
1
vote
1
answer
251
views
Using nobarrier with ext4 and google persisten disks
I was looking into speeding up some heavy DB write workload on google cloud vm. I saw nobarrier option for ext4 FS can provide some performance boost. I was wondering if anyone knows if it is safe to ...
google-cloud-platform
0
votes
1
answer
226
views
directory listing hangs after directory was flooded with > 5 million files
A misconfigured logrotate produced a lot of files in a directory on my server. ls | wc -l showed 5,387,172 files and according to du -sh this summed up to about 8 GB. dmesg showed many errors like ...
- 177
1
vote
1
answer
944
views
Force all files & subdirs that BY ANY MEANS come to be in/under a directory to inherit all permissions and group
I know this question may appear to be a duplicate, because many people have asked related questions about permission inheritance. However, none of the answers I've found address the full scope of what ...
- 111
1
vote
2
answers
776
views
Ext4 metadata checksums: current feature status
The kernel wiki page for ext4 metadata checksums is marked "last modified on 22 October 2013". I couldn't find more recent status information on this feature, except for this question from ...
- 113
1
vote
0
answers
378
views
Convert ext4/xfs file system to btrfs with minimal application impact
I'm trying to find a way to convert the file system of app servers (some of which run ext4 and some xfs) to btrfs. Preferably, I'd like to do this without needing to turn off the services.
So far I've ...
- 11
2
votes
1
answer
3k
views
When enabling ext4 large_dir, how can you tell it's used?
Problem: after enabling the ext4 large_dir option I want to know if it's used and/or whether I need to recreate directories for it to be used.
Detail: I have directories that on occasion can hold ...
- 8,074
1
vote
0
answers
33
views
ext4 restore backup: deleteino: out of range 0
I'm trying to use (dump) restore -command to restore linux ext4 file system from an incremental backup. I'm using a hanoi tower strategy to make the backups, and the dumps look like as follows, sorted ...
- 211
3
votes
1
answer
2k
views
Cheap/fast deduplication with hardlinks?
I've got shared hosting with a few thousand Wordpress installs and I've wanted for ages to have a nice way of removing all the duplicate files in a sensible and secure way.
I'm looking for better disk ...
- 287
4
votes
1
answer
1k
views
mkfs.ext4 error with option -O ^64bit
When I run /sbin/mkfs.ext4 -O ^64bit /dev/app/mysqldata command in a script it gives me below error:
nd(): null: With return code "1", Output from: "/sbin/mkfs.ext4 -O ^64bit /dev/app/...
- 153
2
votes
1
answer
281
views
fsck raid10 ext4 partition currupted, restore data
there is a volume in raid10 /dev/md3
it has a GPT partition /dev/md3p1 in ext4 with a size of 16TB.
I accidentally ran
fsck -y /dev/md3
causing the filesystem in /dev/md3p1 to get corrupted.
fsck -b ...
- 23
0
votes
1
answer
2k
views
between ex4 and XFS which is better for large small files [closed]
Between EXT4 and XFS which file system is better when an application uses multiple threads to read/write large amount of small files on a SSD.
From what I read
In general, Ext3 or Ext4 is better if ...
- 399
0
votes
4
answers
2k
views
What is the purpose of having a "/" and a "/home" partition in linux?
I'm doing a clean install of CentOS 8 minimal, and by default it suggests these paritions:
swap swap 4G
/boot ext3 512M
/ ext4 2014G
/home ext4 all
(this is with a pair of 4TB NVMe drives in ...
- 1,056
3
votes
0
answers
1k
views
Interpreting resize2fs shrink progress (-p) "pass 2" output
The question: What is resize2fs's progress bar indicating during "pass 2" of an offline shrink operation on a large (8-28Tb) ext4 filesystem?
The details:
I've done ~5 resize2fs shrink ...
- 161
0
votes
1
answer
47
views
weird filesystem behavior (corruption?)
Something very weird I came across, any thoughts would be much appreciated:
Some software (httrack) created a directory structure. Using my user (which also ran the software), I cannot view the ...
- 5,949
0
votes
2
answers
464
views
Monitor Linux Server filesystem health and suspicious activities
I run my own, small server here. The server runs on Ubuntu 18.04. There is one single HDD using LVM on a partition together with EXT4. LVM is used for taking snapshots. I also use Webmin with ...
- 101
0
votes
0
answers
366
views
mdadm RAID 10 filesystem corruption -- recoverable?
PROBLEM: I had a degraded disk in my RAID 10 array which I created using mdadm. I first removed the disk, replaced it with a new one, but when I rebuilt, I got an error saying it couldn't detect the ...
0
votes
0
answers
149
views
Linux ext4 incremental backup tool produces individual files not one
I want to backup ext4 files with size (<100MB) as they are, NOT in one single archive file (like with dump or tar).
Can you recommend me a tool that keeps the directories/files structure in the ...
0
votes
3
answers
179
views
We are migrating our wordpress to static site. That is creating over 400,000 folders within 1 folder. Is there any limit to the number of sub-folders?
Our wordpress web site is several years old and has many posts indexed and ranking well on google. With any serious traffic my wordpress server tanks - and this happens even after several rounds of ...
3
votes
1
answer
2k
views
Reason for EXT4 file system corruption of Hyper-V guest
We had our second corruption of an ext4 partition in a relatively short time and ext4 is supposedly very reliable. As this is a virtual machine and the host providing the resources saw no disk errors ...
- 145
5
votes
2
answers
3k
views
Estimating the time needed for a resize2fs shrink
I have a large ext4 filesystem which I'm currently shrinking (109Tb -> 83Tb in my case), and it's taking an extremely long time (Day 5 as of asking). Currently I can see that the process is still ...
- 163
1
vote
1
answer
426
views
Slow disk resize during boot on VMs with Debian 10 Buster images on GCP
resize2fs takes extra 90 seconds to resize 2TB boot disk during boot on Debian 10 than on Debian 9.
Note that time to create/provision VM instance (gcloud compute instances create ...) is the same (...
