Questions tagged [filesystems]
A file system (or filesystem) is a means to organize data expected to be retained after a program terminates by providing procedures to store, retrieve and update data, as well as manage the available space on the device(s) which contain it.
1,995
questions
0
votes
1
answer
422
views
Bad performance on multiple loop devices used as file containers
Currently, I'm managing a back-up service for multiple remote servers. Backups are written trough rsync, every back-up has it's own filecontainer mounted as a loop device. The main back-up partition ...
- 173
0
votes
0
answers
378
views
How to minimize filesystem overhead
I have an application that uses a lot of space as essentially cache data. The more cache available the better the application performs. We're talking hundreds to thousands of TB. The application can ...
- 180
0
votes
1
answer
121
views
Can WAL be turned of on CoW file systems?
As far as I understand WAL in PostgreSQL designed for control of the integrity of Database. On File System same purpose is served by CoW (Copy-on-Write) mechanism.
So WAL look like some overhead. So ...
- 2,465
5
votes
4
answers
2k
views
Why might `ls --color=always` be slow for a small directory?
For a certain directory DIR on my system, the ls --color=always takes about 8 seconds, although it contains less than 10 files and subdirectories. Without the color argument it takes no time.
Why ...
- 101
2
votes
0
answers
470
views
resize2fs shrinking very slow
I tried to shrink a 60TB ext4 to 50TB and it takes about one week to finish.
I know that should take much time but it's very slow even my disks underlying are RAID0.
After some research, it seems ...
- 4,514
0
votes
1
answer
118
views
Too many mounted filesystem
How to umount this cgroup?
Also i have no idea is it important or not. It seem cgroup is comefrom docker but im still not sure.
I was trying install gns3-remote
And it give me cgroup like this.
Then i ...
- 33.3k
1
vote
0
answers
381
views
mdadm RAID: Stuck at 0% Grow (Shrink) reshape due to bad geometry
I have a linux software Raid5 array (md1), containing 4 x 16TB + 2 x 8TB hard drives. 2 x 8TB hard drives were merged together (Raid0 array; md0), working as a (fifth) 16TB device. This is just for ...
- 11
0
votes
2
answers
60
views
Craft a file that ignores all writes without being marked as read-only
(Ubuntu 11.04.)
I'd like to work around a configuration limit a certain service that writes an append-only file.
I'll have that file mounted from a remote machine (say, by NFS, can change this). I ...
- 131
2
votes
1
answer
1k
views
Why does active-active configuration degrade performance compared to failover?
We are setting up the new storage for an HPC compute cluster that we are managing for applied statistics, bioinformatics, and genomics.
Configuration
We have the main enclosure with a Dell EMC ME4084 (...
0
votes
1
answer
414
views
Single SAN with ocfs2 and gfs2
I have a single SAN with two virtual drives. (i.e., they are separate mounts, but they are mapped to the same IP address) For example, if I do ls /dev/disk/by-path/, I see this:
ip-172.16.100.5:3260-...
- 167
2
votes
1
answer
1k
views
After filesystem reached 100% storage capacity now set to read-only, how to reset to read-write mode?
Yesterday our server (Ubuntu 18.04) reached 100% storage capacity
and set one of our filesystems to read-only mode, see: /dev/md3 / ext4 ro,relatime,errors=remount-ro,data=ordered 0 0. I've tried ...
- 12.6k
2
votes
2
answers
4k
views
Puppet "file" resource emptied a directory
I'm in the somewhat embarrassing position of having unintentionally deleted multiple TB of important data via Puppet, and I'm just trying to understand why this might have happened.
Firstly, I'm ...
- 620
0
votes
2
answers
3k
views
GlusterFS SSL not working
I have been trying for hours to get GlusterFS SSL workong on the management and I/O path to no avail, so I hope you can help me.
I have tried it the simple way:
openssl genrsa -out glusterfs.key ...
- 2,315
1
vote
1
answer
39
views
MySQL 1 schema, 1 filesystem
This is a ''general'' question. Hear me out.
Let's say I have a MySQL standalone or even a 3 or 5 nodes cluster.
Would it be a good practice to have 1 filesystem per schema ?
For example, schema{1..5} ...
- 2,558
34
votes
7
answers
13k
views
How beneficial are self-healing filesystems for general usage?
I have recently looked into advanced filesystems (Btrfs, ZFS) for data redundancy and availability and got interested in the additional functionality they provide, especially their "self-healing" ...
- 197
1
vote
0
answers
91
views
Why am I allowed to move, but not delete, a file on Windows Server 2019?
Today I needed to remove a file, but I couldn't:
[capv@TKG-VC-ANTREA-M]: C:\Users\capv> rm 'C:\Program Files\containerd\containerd-shim-runhcs-v1.exe'
rm : Cannot remove item C:\Program Files\...
- 4,514
5
votes
0
answers
13k
views
Mount filesystem with "structure needs cleaning" on ext4
There is a created years ago(and many time resized from that times) filesystem with ext4. After power failure it stop to mount.
When i try to mount it manually i receive an error:
# mount /dev/space/...
- 1,076
-1
votes
1
answer
176
views
Windows Server 2019 - renaming files with some naming convention
We received a ton of files from our sponsor and the files are all formatted like this
[ABCD] Title - Id - Description [RS][x264][CHKSUM].txt
I could manually rename one at a time but there are more ...
- 486
7
votes
2
answers
46k
views
tune2fs: Bad magic number in super-block while trying to open /dev/sdb1
I am experiencing the above problem and I have no idea what caused this. Can someone help me figure this out?
1) I have already had my first disk /dev/sda working properly, now I am trying to ...
- 2,766
1
vote
0
answers
109
views
Upgrading packages caused database to crash
A really strange confluence of dependencies led to an odd database crash. Context:
CentOS 7.9
LVM2-2.02
Postgresql 12, with data volume on an LVM volume, XFS formatted
systemd
dbus
While the system ...
- 459
2
votes
1
answer
1k
views
How do I check a remote file systems mount permissions?
I'm mounting a test server to a shared filesystem at work. It's a cifs mount so im looking at this reference page: https://linux.die.net/man/8/mount.cifs
I want to try and mount in a "know as ...
- 2,449
0
votes
0
answers
64
views
Why did I suddenly gain 300GB on my server
I've been working on my server all day, doing various things. I know, unquestioningly (found the evidence by scrolling up in one of my terminal sessions) that I had about 900GB of space 4 hours ago. ...
- 1,138
1
vote
1
answer
2k
views
How to monitor when a file/folder is moved, and where it moved to?
I'm looking for a way to monitor when a file/folder is moved, as well as where it was moved to.
So far in my research I've come across tools such as auditd, watch and inotify. While these tools are ...
- 824
0
votes
2
answers
161
views
How to delete specific files? [duplicate]
I'm running Ubuntu 20.04. I have a directory with million of files named like this
master-stdout.log.20210801.024908
master-stdout.log.20210801.025524
master-stdout.log.20210801.064355
How can I ...
- 1,306
0
votes
1
answer
1k
views
Rsync : Preserve date after copying
I have an issue with files attributes since I changed my company's file system from an old ubuntu 12 to a Synology NAS.
I initially mounted NFS shares on my old file system, then with cp I copied ...
- 1
1
vote
1
answer
285
views
Needs to set nodev option on DB directories in linux
I have created two directory for new build linux server & each directory is 200GB in size and will be used for DB . security team did scan they found vulnerability as " No nodev option set ...
- 9,284
1
vote
1
answer
247
views
CentOS /dev/mapper/centos partition consumes randomly more & more storage with time
On our CentOS 7.3.1611 system with installed MariaDB, httpd and Postfix the partition /dev/mapper/centos_srv01-root gets with more time more & more full.
For two days (2021-07-21) is the output ...
- 248k
-3
votes
1
answer
504
views
What file systems are dominantly used in data centers? [closed]
I would like to know what file systems are typically used in data centers and how do their performance compare to ext3/4 file system?
- 111
1
vote
2
answers
642
views
Understanding buff/cache and tmpfs relationship on a read only filesystem with no swap
We have a really strange bug where a Yocto operating system running on a Raspberry Pi will 'lock up' because of disk IO wait.
Scenario:
operating system runs read only and has no swap
there is a ...
- 123
3
votes
1
answer
1k
views
e2fsck cleans a filesystem and then a few minutes later (after a lot of reads) there are errors
The filesystem is on an LVM RAID5. It appears to be working correctly:
$ sudo pvs
[sudo] password for jrwren:
PV VG Fmt Attr PSize PFree
/dev/sda2 datavg lvm2 a-- <7.28t ...
- 354
2
votes
0
answers
1k
views
why do I get bad superblock on /dev/sda, missing codepage or helper program?
Check this:
root@dev:~# lsblk -f|grep sda
sda ext4 1.0 21ca0461-0e80-4468-b942-3735e9fd4945
root@dev:~# grep /db /etc/fstab
UUID=21ca0461-0e80-4468-b942-...
- 294
1
vote
2
answers
947
views
Ext4 metadata checksums: current feature status
The kernel wiki page for ext4 metadata checksums is marked "last modified on 22 October 2013". I couldn't find more recent status information on this feature, except for this question from ...
- 9,783
2
votes
1
answer
898
views
btrfs - data usage in <ERROR> with inappropriate ioctl for device
I'm attempting to trace down what's using some of the space on my btrfs filesystem. There is a large difference between btrfs fi du -s / and btrfs fi usage / and the difference seems to be in the <...
- 1,812
52
votes
3
answers
94k
views
.nfsXXXX files appearing, what are those?
I have an application running (on RHEL5) that streams data onto an NFS share. Recently, I saw a lot of .nfsXXXX... (xxx being a hexadecimal number) appearing in its working directory, where the ...
CommunityBot
- 1
0
votes
0
answers
151
views
file system requirements for postgresql and/or mysql
I'm currently tasked with making postgresql run in kubernetes in azure using a azureFile for storage.
There are numerous posts and github issues stating that postgresql cannot run with azureFile. The ...
- 101
0
votes
1
answer
90
views
Filesystem to protect the storage medium
I'm working on an embedded system which will act as a server, the problem is the environment where it will run is so aggressive and it will suffer abrupt power interruptions. So I'm planning to mount ...
- 33.3k
14
votes
6
answers
84k
views
How to find cause of main file system going to read only mode
Ubuntu 12.04
File system goes to readonly mode frequently.
First of all I have read this question file system is going into read only mode frequently already.
But I have to know if it's not caused ...
- 604
2
votes
1
answer
2k
views
Sort df Output by Mount Point
I need to get the output of df -h sorted alphabetically by its mount point in the Mounted on column.
However, df -h currently outputs similar to this:
$ df -h
Filesystem Size Used Avail Use% ...
- 4,690
0
votes
1
answer
97
views
Is fscrypt encryption FIPS compliant?
I am considering to use https://www.kernel.org/doc/html/v4.19/filesystems/fscrypt.html to encrypt directory files and just wondered if the encryption with fscrypt is complaint with FIPS. If so, would ...
1
vote
1
answer
573
views
Can really big folder (more than one million files) slow Nginx down?
I mean, if I have the following folder structure:
www/lang/comp/ - more than a million files here. Will the worker slowed down by looking for a file?
For example, https://example.com/lang/comp/comp-...
- 4,165
2
votes
1
answer
284
views
Enabling 8dot3name functionality on massive external drive
We've just switched to a new file server, but a lot of our designers are having issues with file names which are too long. We have enabled LongPathsEnabled but the issues remain specifically for Adobe ...
- 3,469
2
votes
1
answer
160
views
Unknown filesystems on RAID5 partitions
I am trying to retrieve data from NAS (Acer Altos EasyStore M2) with dead mainboard.
System in the NAS is based on CentOS 5 and some software from Falcon (FalconStore) is used.
I removed disks from ...
- 121
2
votes
3
answers
646
views
zfs on a single device: what happens when a file is corrupted?
It is written everywhere that ZFS is helpful even if you only have one physical device, because it will tell you about data corruption due to bit decay and such.
However, can it actually address such ...
- 5,726
5
votes
1
answer
192
views
File locked only for Developer that tries to deploy
Our Developers work with VisualStudio 2017
They use a Post-Build PowerShell function that I wrote, to publish the application to the correct destination.
Sometimes (1 out of 100 times) they get the ...
- 113
1
vote
0
answers
562
views
Is there a way to restrict the maximum path length to a directory on Linux and/or OpenZFS?
I have a ZFS filesystem (ZFS version 0.8.5) on Linux (kernel 3.10.0) for which I'd like to restrict the total path length on nested directories. I'm not sure if there's a way to do that, though.
My ...
- 3,146
3
votes
0
answers
519
views
What linux distro support Host Managed HDD by file system?
According to this Seagate presentation there are some ongoing (?) efforts targeted toward modification of ext4 file system introducing SMRFS -EXT4 - support of host managed hard drives. The goal is to ...
- 131
1
vote
0
answers
4k
views
Docker overlay2 file system corruption
I have a small home server where I host a few services I like. Recently the server enters a read only state on the main LVM volume, this is the volume where Ubuntu is installed. I have very little ...
- 41
0
votes
1
answer
44
views
Moving Files After Conversion to pdf
I have created a linux script to convert files from .odt to .pdf
But the script after converting moves files into same dir where script is executed. As script is recurring I want files to stay in the ...
- 27
0
votes
0
answers
111
views
File not found/read error if file accessed immediately after saving it
I am running CentOS 7, working on a synchronously mounted network drive (NFS).
EDIT: more system info:
Server is running CentOS Linux release 7.3.1611 (Core) with kernel 3.10.0-514.16.1.el7.x86_64 and ...
- 2,766
2
votes
1
answer
1k
views
How to forward new files from an SFTP server?
I have an sftp server that partners send files to. As soon as the file arrives in the sftp directory, I want to read its contents and send the contents for further processing to another server.
To ...
- 50.7k