Questions tagged [filesystems]
A file system (or filesystem) is a means to organize data expected to be retained after a program terminates by providing procedures to store, retrieve and update data, as well as manage the available space on the device(s) which contain it.
1,995
questions
23
votes
7
answers
22k
views
Copy permissions to identical tree on linux / unix
i have a tree of files with correct permission. then i have a (filewise) identical tree (with different file contents tough) with wrong permissions.
how can i transfer the permissions layout from ...
- 375
23
votes
6
answers
37k
views
How to clean up an unprocessed orphan inode list?
I tried to mount a formerly readonly mounted filesystem read-writeable:
mount -o remount,rw /mountpoint
Unfortunately it did not work:
mount: /mountpoint not mounted already, or bad option
dmesg ...
- 2,349
23
votes
6
answers
9k
views
Best way to prevent the root system filling up when a mount fails?
We have an internal web server (virtualized, hosting ReviewBoard, but not super relevant) and we have a relatively consistent failure mode with failed NFS mounts causing / to fill up. Distro is Ubuntu ...
- 333
23
votes
2
answers
19k
views
What is the sticky bit in UNIX file systems? When is it used?
What is the sticky bit in a UNIX file system?
As an admin when and how would you use it?
- 1,525
22
votes
8
answers
23k
views
Doing an rm -rf on a massive directory tree takes hours
We're using rsnapshot for backups. It keeps lots of snapshots of the backuped up file, but it does delete old ones. This is good. However it's taking about 7 hours to do a rm -rf on a massive ...
- 32.3k
21
votes
7
answers
8k
views
Which filesystem for large LVM of disks (8 TB)?
I have a Linux server with many 2 TB disks, all currently in a LVM resulting in about 10 TB of space. I use all this space on an ext4 partition, and currently have about 8,8 TB of data.
Problem is, I ...
- 221
21
votes
2
answers
26k
views
Is there a quick way to see what filesystem filter drivers are loaded on Windows 2008?
The question says it all, I think. I vaguely remember there was an easy way to do this, but don't remember what it was.
- 664
21
votes
11
answers
96k
views
How to tell what computer has a file open on a network share?
Environment:
Windows XP sp3,
Windows 2003 server
Problem:
We have several dozen kiosk machines each with the same logon name who occasionally and briefly a file on a share. The rate is several ...
- 2,816
20
votes
7
answers
4k
views
Linux mv file with long name
In Linux I sometimes rename files like this:
mv dir1/dir2/dir3/file.txt dir1/dir2/dir3/file.txt.old
Note that I want to just rename the file, not move it to another directory.
Is there a command ...
- 445
20
votes
5
answers
22k
views
Is execution of sync(8) still required before shutting down linux?
I still see people recommend use of sync; sync; sync; sleep 30; halt incantations when talking about shutting down or rebooting Linux.
I've been running Linux since its inception and although this ...
- 859
20
votes
7
answers
22k
views
What is the best filesystem for insert performance on PostgreSQL?
I'm curious if anyone out there has done any experimentation or comparisons between file systems and database performance. On Linux, I'm wondering what is the optimal file system for a postgres ...
- 547
20
votes
3
answers
58k
views
How long should resize2fs take on a 1TB partition?
I've got a new computer at the university and almost set up everything for myself on it when I've noticed that the previous user of the machine used a huge 1TB ext3 partition only.
I usually keep /...
- 303
19
votes
9
answers
32k
views
Is it possible to hide lost+found?
Given a partition intended solely for storing music, video and so-on, is it possible to hide the lost+found directory?
- 14.5k
19
votes
3
answers
64k
views
ext4 file-system max inode limit - can anyone please explain?
Recently we had a problem where one of the ext4 file-systems seemed unable to handle very large number of files, more than 6mln in this case, in spite of having enough space. Is it 6mln the max number,...
- 479
19
votes
4
answers
12k
views
"No space left on device" error despite having plenty of space, on btrfs
Almost everywhere I'm getting failures in logs complaining about No space left on device
Gitlab logs:
==> /var/log/gitlab/nginx/current <==
2016-11-29_20:26:51.61394 2016/11/29 20:26:51 [emerg]...
- 295
19
votes
2
answers
13k
views
Why does chmod(1) on the group affect the ACL mask?
I am trying to understand this Unix behavior (which I happen to be testing on Ubuntu 11.10):
$ touch foo
$ setfacl -m u:nobody:rwx foo
$ getfacl foo
# file: foo
# owner: michael
# group: michael
user:...
- 869
19
votes
13
answers
356k
views
Error 0x80070570: How to delete corrupted and unreadable file?
On my system partition I have a folder which cannot be deleted. This folder has been created by restoring files from an Acronis TrueImage backup.
The error message says:
Error 0x80070570: The file ...
- 243
19
votes
2
answers
6k
views
Is there any way to fix a corrupted LDM database?
TL;DR:
Are there any tools/approaches to diagnosing and fixing LDM
(Logical Disk Manager) metadata structures without recreating
from scratch?
Full description:
I have two SSD drives set up ...
- 2,368
18
votes
6
answers
48k
views
Which is faster, and why: transferring several small files or few large files?
I soon will have a folder with thousands of files, each file on the order of a few KB. I will need to transfer these across a Windows network from one UNC share to another. In general, is it faster ...
- 183
18
votes
8
answers
25k
views
Find files in one directory not in another
Are there any Linux/Unix tools which find all the files in one directory not present in another? Basically I'm looking for diff which works on the output of ls.
Short and sweet scripts are also ...
- 375
18
votes
8
answers
8k
views
Is btrfs production ready?
I've seen a lot of information on btrfs lately. I have been considering ext4 for my next filesystem, but am tempted by btrfs instead. How widely used is btrfs? What are the pro's and con's?
- 11.9k
18
votes
4
answers
56k
views
File locks on an NFS?
My server uses NFS (Network File System), and I'm unable to use PHP's flock() -function. Is there a way to lock files on an NFS or is there a need to do so?
- 367
18
votes
7
answers
49k
views
Too many open files on Debian
I have long running process at Debian. At some point in throw an error:
Too many open files.
Running:
ulimit -a
shows:
open files (-n)
1024
I wish to increase number ...
- 427
18
votes
13
answers
5k
views
How can I visualize hard disk space with millions of files?
We have a hard disk that is 600 Gigs and nearly full. It's been filled up with 18,501,765 files (mostly small 19k images) and 7,142,132 folders. It's very difficult to find out where exactly all the ...
18
votes
4
answers
4k
views
Ensuring a repeatable directory ordering in linux
I run a hosted continuous integration company, and we run our customers' code on Linux. Each time we run the code, we run it in a separate virtual machine. A frequent problem that arises is that a ...
- 328
18
votes
2
answers
62k
views
How to remove bad disk from LVM2 with the less data loss on other PVs?
I had a LVM2 volume with two disks. The larger disk became corrupt, so I cant pvmove.
What is the best way to remove it from the group to save the most data from the other disk?
Here is my pvdisplay ...
- 302
18
votes
4
answers
12k
views
To fsck or not fsck after 180 days
By default after 180 days or some number of mounts, most Linux filesystems force a file system check (fsck). Of course this can be turned off using, for example, tune2fs -c 0 -i 0 on ext2 or ext3.
On ...
- 708
18
votes
4
answers
14k
views
zfs rename/move root filesystem into child
Similar question exists but the solution (using mv) is awful because in this case it works as "copy, then remove" rather than pure "move".
So, I created a pool:
zpool create tank /dev/loop0
and ...
- 181
18
votes
3
answers
18k
views
GlusterFS vs Ceph, which is better for production use for the moment? [closed]
I am evaluating GlusterFS and Ceph, seems Gluster is FUSE based which means it may be not as fast as Ceph. But looks like Gluster got a very friendly control panel and is ease to use.
Ceph was ...
- 949
17
votes
3
answers
84k
views
How can I mount a partition on every reboot?
I have a partition mounted with mount -t ext3 /dev/sda3 /foo.
Each time I reboot, I need to remount. How can I keep this mounted after every reboot?
- 259
17
votes
4
answers
40k
views
Command line recursive/deep directory copy in Linux?
What is a good, general way to make a recursive/deep directory copy in Linux that works in most cases? I've used simple things like cp -R as well as fairly elaborate cpio incantations. Are there any ...
- 344
17
votes
3
answers
15k
views
How to list content from a tar file without recursion?
I've a tar (gz, bzip) file and want to see its content, but not recursively.
This is: The "first level" in the file.
I already know how to see content:
tar -ztf file.tar.gz
But it's recursive!!
...
- 598
17
votes
2
answers
3k
views
ext4 listing of files very slow in one specific directory that contained lots of files before
Background
I had a small logrotate misshap... Logrotate would rotate the archived logs by misstake causing a quadratic growth of files in my /var/log/. And by the time I caught wind that something ...
- 414
17
votes
7
answers
37k
views
How to compare two directories (including sub directories) for differences?
How can I compare two directories with sub dirs to see where is the difference?
- 13.4k
17
votes
5
answers
7k
views
Is there a way to create a copy-on-write copy of a directory?
I'm thinking of a situation where I would have something that creates a copy of a directory, tweaks a few files, and then does some processing on the result. This wold be done fairly often, maybe a ...
- 1,075
17
votes
2
answers
17k
views
Read/write access for passthrough (9p) filesystems with libvirt/qemu?
I have recently started experimenting with the support for passthrough filesystems in recent versions of KVM/QEMU/libvirt. Making the filesystems available for read access has "just worked", but I'm ...
- 44.9k
16
votes
3
answers
6k
views
Program file exists in /usr/bin, but cannot be used
Clearly my file exists in /usr/bin
$ ls /usr/bin/ngrok
/usr/bin/ngrok
However, when I attempt to chown it I receive an error
$ sudo chown my_user:users /usr/bin/ngrok
chown: cannot dereference '/...
- 177
16
votes
8
answers
89k
views
'Permission denied' to a file I own?
My user, bob, can't access files that he (theoretically owns). I'm running Fedora Core 8. It probably easier to shown than tell:
> ls -al .
total 32
drwxrwxr-x 7 bob bob 4096 May 18 14:33 .
...
- 263
16
votes
7
answers
13k
views
In *nix, how to determine which filesystem a particular file is on?
In a generic, modern unix environment (say, GNU/Linux, GNU/Solaris, or Mac OS X), is there a good way to determine which mountpoint and filesystem-type a particular absolute file path is on?
I ...
- 705
16
votes
3
answers
51k
views
Is there a hard limit to the number of files a directory can have? [duplicate]
Wondering if there is a limit to the number of files that can be stored inside a directory, in CentOS 6. There is one particular directory which could potentially have millions of subdirectories.
...
- 677
16
votes
5
answers
40k
views
How do I list a file's data blocks on Linux?
As I understand it, each file on a Unix-like operating system has an inode number (which can be viewed with "ls -i"), and each inode is a list of disk blocks that contain the actual data of a file.
...
- 4,013
16
votes
9
answers
12k
views
Calculating total file size by extension in shell
We have a set of directories containing lucene indexes. Each index is a mix of different file types (differentiated by extension) eg:
0/index/_2z6.frq
0/index/_2z6.fnm
..
1/index/_1sq.frq
1/index/...
- 293
16
votes
8
answers
2k
views
Optimal UNIX File System Partition + Setup Strategy
When partitioning a new system disk(s) for UNIX, what is your prefered strategy for both desktop and/or servers?
Please include disk partition layout, file system format(s) and options, mount points, ...
- 1,303
16
votes
4
answers
11k
views
max files per directory in ext4
I manage an application that contains a filestore in which all the files are stored with the filenames equal to their md5 sums. All files are stored in one directory. Currently there are thousands, ...
- 2,239
16
votes
3
answers
14k
views
Proper way to create a zfs off an existing directory?
Lets say I have an rpool with etc/ as a regular directory within it and now I want to create a separate zfs rpool/etc, obviously inheriting all the data I had in original /etc.
What would be the most ...
16
votes
4
answers
7k
views
Vagrant shared folder and file change events
I have ubuntu virtual machine that I'm accessing through Vagrant.
On my host (Mac OSX), there is a folder with couple of files, that I share to virtual machine. In that virtual machine, I want to use ...
- 273
16
votes
2
answers
10k
views
Production-ready, highly reliable filesystems on Linux: ext4 ext3 XFS or JFS (or ZFS)?
The last real question I've seen on this topic is from about two years ago (is ext4 ready for production usage).
In the intervening time, how has ext4 improved?
XFS, JFS, and ext3 are the standby ...
- 18.7k
15
votes
3
answers
24k
views
How to remove "._" files in a directory? Ubuntu
Is there a command line to remove all "._foo.html" files in a directory on Unbuntu?
15
votes
6
answers
17k
views
Linux: Case-INSENSITIVE Filesystem
What methods are there to make the Linux filesystem case-INSENSITIVE ?
I have asp.net applications developed on Windows, but there are always issues with capitalization/spelling on mono when putting ...
- 1,024
15
votes
5
answers
14k
views
Which "features" of ext4 existing ext4 partition uses?
When I create ext4 filesystem, there are many "features", which I can enable and disable - like has_journal, extent, huge_file and so on. Is there any way to know, which options were used while ...
- 335