Questions tagged [ext4]
The ext4 or fourth extended filesystem is a journaling file system for linux/*nix developed as the successor to ext3.
448
questions
0
votes
0answers
40 views
What linux distro support Host Managed HDD by file system?
According to this Seagate presentation there are some ongoing (?) efforts targeted toward modification of ext4 file system introducing SMRFS -EXT4 - support of host managed hard drives. The goal is to ...
3
votes
0answers
25 views
Are My Drives Being Utilized Equally with Linux Software RAID 0 Array?
I have four NVMe drives in a RAID 0 configuration.
I am attempting to determine how many IOPS the array is handling.
When I run iostat, it appears that one drive is handling more IO than the other ...
0
votes
1answer
36 views
Using nobarrier with ext4 and google persisten disks
I was looking into speeding up some heavy DB write workload on google cloud vm. I saw nobarrier option for ext4 FS can provide some performance boost. I was wondering if anyone knows if it is safe to ...
google-cloud-platform
0
votes
0answers
10 views
directory listing hangs after directory was flooded with > 5 million files
A misconfigured logrotate produced a lot of files in a directory on my server. ls | wc -l showed 5,387,172 files and according to du -sh this summed up to about 8 GB. dmesg showed many errors like ...
0
votes
0answers
23 views
Force all files & subdirs that BY ANY MEANS come to be in/under a directory to inherit all permissions and group
I know this question may appear to be a duplicate, because many people have asked related questions about permission inheritance. However, none of the answers I've found address the full scope of what ...
0
votes
0answers
29 views
Ext4 metadata checksums: current feature status
The kernel wiki page for ext4 metadata checksums is marked "last modified on 22 October 2013". I couldn't find more recent status information on this feature, except for this question from ...
1
vote
0answers
66 views
Convert ext4/xfs file system to btrfs with minimal application impact
I'm trying to find a way to convert the file system of app servers (some of which run ext4 and some xfs) to btrfs. Preferably, I'd like to do this without needing to turn off the services.
So far I've ...
1
vote
1answer
129 views
When enabling ext4 large_dir, how can you tell it's used?
Problem: after enabling the ext4 large_dir option I want to know if it's used and/or whether I need to recreate directories for it to be used.
Detail: I have directories that on occasion can hold ...
1
vote
0answers
14 views
ext4 restore backup: deleteino: out of range 0
I'm trying to use (dump) restore -command to restore linux ext4 file system from an incremental backup. I'm using a hanoi tower strategy to make the backups, and the dumps look like as follows, sorted ...
0
votes
0answers
50 views
write ext4 hdd is slower than ntfs on samba server linux
I recently installed a samba server on ubuntu server (intel celeron 1.6ghx 4gb ram)
i have two hdd , in ext4 and ntfs. all forum says that the native file system are better but i have
a speed slow ...
2
votes
1answer
1k views
Cheap/fast deduplication with hardlinks?
I've got shared hosting with a few thousand Wordpress installs and I've wanted for ages to have a nice way of removing all the duplicate files in a sensible and secure way.
I'm looking for better disk ...
3
votes
1answer
230 views
mkfs.ext4 error with option -O ^64bit
When I run /sbin/mkfs.ext4 -O ^64bit /dev/app/mysqldata command in a script it gives me below error:
nd(): null: With return code "1", Output from: "/sbin/mkfs.ext4 -O ^64bit /dev/app/...
2
votes
1answer
98 views
fsck raid10 ext4 partition currupted, restore data
there is a volume in raid10 /dev/md3
it has a GPT partition /dev/md3p1 in ext4 with a size of 16TB.
I accidentally ran
fsck -y /dev/md3
causing the filesystem in /dev/md3p1 to get corrupted.
fsck -b ...
0
votes
1answer
38 views
between ex4 and XFS which is better for large small files [closed]
Between EXT4 and XFS which file system is better when an application uses multiple threads to read/write large amount of small files on a SSD.
From what I read
In general, Ext3 or Ext4 is better if ...
0
votes
0answers
60 views
Is this some form of filesystem corruption?
The second column in the output of ls -l should, according to this answer, be the number of symbolic links to the directory.
Now I get this:
root@ip-172-31-7-136:/xx/yy/zz/# ls -l
total 15644
drwxr-xr-...
0
votes
0answers
16 views
Does increasing inodes cause any performance issues?
I am currently running nginx and have a specify volume attache to my ec2 instance for be used for caching. With cache zone configuration
proxy_cache_path /var/cache/nginx/myapp levels=2:2:2 keys_zone=...
0
votes
0answers
144 views
Newly Created VirtualBox VDI ext4 Occupying 24GB Actual Space?
I created a new dynamic vdi disk. Then, from within the guest, I used fdisk to mkfs.ext4. I then shut down the guest and saw this in my vbox:
The only thing I saved to the disk so far (Before ...
0
votes
0answers
25 views
Google Cloud ext4 errors
i have following problems with urbackupclient and a google cloud maschine:
EXT4-fs error (device dm-0): ext4_lookup:1594: inode #2048052: comm file indexing: deleted inode referenced: 4393654
I ...
0
votes
4answers
135 views
What is the purpose of having a “/” and a “/home” partition in linux?
I'm doing a clean install of CentOS 8 minimal, and by default it suggests these paritions:
swap swap 4G
/boot ext3 512M
/ ext4 2014G
/home ext4 all
(this is with a pair of 4TB NVMe drives in ...
2
votes
0answers
92 views
Interpreting resize2fs shrink progress (-p) “pass 2” output
The question: What is resize2fs's progress bar indicating during "pass 2" of an offline shrink operation on a large (8-28Tb) ext4 filesystem?
The details:
I've done ~5 resize2fs shrink ...
0
votes
1answer
34 views
weird filesystem behavior (corruption?)
Something very weird I came across, any thoughts would be much appreciated:
Some software (httrack) created a directory structure. Using my user (which also ran the software), I cannot view the ...
0
votes
0answers
98 views
NGINX directio is not working (O_DIRECT flag in open(2) sys call )
Nginx configuration is
location /conent/ {
directio 200k;
directio_alignment 4k;
}
Using SSD with ext4 file system with 4k block size, and journaling has been disabled, linux kernal version is 5.4., ...
0
votes
2answers
137 views
Monitor Linux Server filesystem health and suspicious activities
I run my own, small server here. The server runs on Ubuntu 18.04. There is one single HDD using LVM on a partition together with EXT4. LVM is used for taking snapshots. I also use Webmin with ...
0
votes
0answers
145 views
mdadm RAID 10 filesystem corruption — recoverable?
PROBLEM: I had a degraded disk in my RAID 10 array which I created using mdadm. I first removed the disk, replaced it with a new one, but when I rebuilt, I got an error saying it couldn't detect the ...
0
votes
0answers
44 views
Linux ext4 incremental backup tool produces individual files not one
I want to backup ext4 files with size (<100MB) as they are, NOT in one single archive file (like with dump or tar).
Can you recommend me a tool that keeps the directories/files structure in the ...
0
votes
3answers
125 views
We are migrating our wordpress to static site. That is creating over 400,000 folders within 1 folder. Is there any limit to the number of sub-folders?
Our wordpress web site is several years old and has many posts indexed and ranking well on google. With any serious traffic my wordpress server tanks - and this happens even after several rounds of ...
3
votes
1answer
736 views
Reason for EXT4 file system corruption of Hyper-V guest
We had our second corruption of an ext4 partition in a relatively short time and ext4 is supposedly very reliable. As this is a virtual machine and the host providing the resources saw no disk errors ...
5
votes
2answers
660 views
Estimating the time needed for a resize2fs shrink
I have a large ext4 filesystem which I'm currently shrinking (109Tb -> 83Tb in my case), and it's taking an extremely long time (Day 5 as of asking). Currently I can see that the process is still ...
1
vote
1answer
180 views
Slow disk resize during boot on VMs with Debian 10 Buster images on GCP
resize2fs takes extra 90 seconds to resize 2TB boot disk during boot on Debian 10 than on Debian 9.
Note that time to create/provision VM instance (gcloud compute instances create ...) is the same (...
1
vote
1answer
86 views
Can't write on Samba4 share using Zentyal 6.1 server, after upgrading from 5, read only is allowed
I can't write on all my clients (Windows 7 and Windows 10) in all my samba shares, even if the users are accepted on domain, and the permissions was maintained. The shares are on a NAS, ISCSI ...
1
vote
0answers
44 views
Physical Volume Actual Utilization for replacement
I have a Volume Group which consist two physical volume of size 10TB each SSD & NLSAS (yes one very slow and other very fast) so total 20TB.
I created Volume backupvg with the 10TB SSD & ...
3
votes
3answers
1k views
Linus/ext4/nvme crashes during high io
During mvn compilation, I have random crashes.
The problem seems related to high IO and in kern.log, I can see things like:
kernel: [158430.895045] nvme nvme1: controller is down; will reset: CSTS=...
0
votes
1answer
738 views
How to mount a LVM controlled ext4 file system stored on a AWS EBS volume built from a snapshot
I have a ext4 file system that is part of a Logical Volume and the underlying storage is AWS EBS. I took a snapshot of the EBS and then used that to create a new EBS volume and attached it to theEC2 ...
35
votes
5answers
42k views
Ext4 vs. XFS vs. Btrfs vs. ZFS for NAS [closed]
My use case: I have Ubuntu Server 18.04 installed on an M.2 SSD. I have a 4TB HDD I want to add as storage. Since it's mostly for large media files and backups, it won't be written to very often.
...
1
vote
1answer
265 views
SQLite WAL concurrent write performance on UNIX systems
I have two setups: one runs on windows 10 (ntfs partition), the other on debian (ext4 partition). The R source code is the same. The main process starts 8 child-processes (P-SOCKS) -- on 8 vcores -- ...
1
vote
2answers
175 views
Recover MySQL tables from removed Proxmox VM
Have the stand-alone Proxmox node with LVM thin and VM 130 volume /dev/pve/vm-130-disk-0 inside it.
VM 130 was deleted accidentally.
Mysql database was lost with VM.
After we've discovered it in a day,...
1
vote
0answers
503 views
I've killed the processes that held the deleted files, but a filesystem is still full
I have a host that runs CentOS-6 with Linux 2.6.32-696.18.7.el6.x86_64 (yes, pretty old) and I ran out of disk space on the root filesystem.
The filesystem's size is 16G, du shows about 3G being used ...
0
votes
1answer
988 views
Why I cant read/mount on macosx external disk formatted extfat?
I have connected via USB this SATA disk previously mounted on a Linux system in a RAID 1 HW configuration:
I have installed ext4fuse to mount the FS.
First of all I checked the drive with:
...
1
vote
1answer
208 views
ext4 raid5 corrupt group descriptor
I have a raid5 NAS on Open Media Vault, with 3x 2To disks.
A few days ago I've inserted a spare disk from another raid.
I did not see it at the beginning, but I think that changed disks order.
Then I ...
0
votes
1answer
65 views
Run similar disk intensive tasks parallel or serial on regular Linux?
Scenario
I'm on a regular Ubuntu 18.04 LTS with ext4 Filesystems.
I'm using restic to backup my machines. Restic is a backup tool that support different backends (local, sftp, aws, gcs, ..) but only ...
0
votes
0answers
85 views
Any benefits of ZFS over EXT4 for data stream processing on top of HDFS?
I'm working on a data stream processing project in which i will be using Apache Flink and Apache Spark and I want to use HDFS for storage. The development and testing will be done on a single node ...
1
vote
1answer
1k views
Best block size for fio when reading a file
To pre-warm an ext4 EBS volume I'm using fio as follows:
fio --name <filename> --filename <filename> --rw read --direct 1 --ioengine libaio --bs <X>k
and I'm trying to understand ...
6
votes
3answers
2k views
How to write a sparse Linux (EXT4) disk image without writing gigabytes of zeros?
I have a 64 GB Linux disk image with ~50 GB of unused space across the partitions. The file is sparse, so it only takes ~14 GB on disk.
But if I dd the image, it writes the full 64 GB, which takes ...
1
vote
7answers
425 views
Print unused bytes of logical volume
Imagine the physical volume was resize with:
pvresize /dev/sda2
And the logical volumne was resized with:
lvresize -l +100%FREE system/home
But this command was not done:
resize2fs /dev/mapper/...
0
votes
1answer
483 views
EXT4 filesystem data loss running Debian 9 under KVM
I'm trying to setup KVM virtualization on a CentOS 7.6.1810 host. This is a machine with a Xeon E-2176G CPU and a double 1 TB SSD drive. The SSDs are configured as software raid.
Personalities : [...
0
votes
1answer
2k views
Bad magic number in super-block : Red Hat 6
I extended a disk on RHEL 6.9. I am getting superblock error when running resize2fs on the new disk.
This was the previous filesystem layout before resizing:
Disk /dev/sdc: 289.9 GB, 289910292480 ...
0
votes
1answer
33 views
Where are files on the disk when using ext4?
For a job, I have to wipe a lot of disks that contain sensitive information. Those disks are all identical, I cannot wipe more than one at the same time, and fully wiping one takes me a full hour.
To ...
2
votes
1answer
323 views
output of cat /proc/sys/fs/inode-nr vs df -i
What's the difference between the output of
cat /proc/sys/fs/inode-nr
and
df -i
Both are documented at returning the number of inodes in use, but they return apparently unrelated numbers.
$ df -...
2
votes
1answer
158 views
Diagnosing missing logical volume
EDIT: the system boots off a 16 gigabyte USB key.
Apparently, at some point, the 'device name' (sorry if I'm using that term incorrectly) of the boot device changed.from /dev/sde to /dev/sdb to /dev/...
-3
votes
2answers
93 views
Huge data loss in RAID 1 array [closed]
I've recently faced a huge data loss (everything from last 5 months) after one of my disk crashed, even if the RAID array is still fine.
This disk was a SSD with my root partition (ext4), mirrored in ...
