Questions tagged [filesystems]
A file system (or filesystem) is a means to organize data expected to be retained after a program terminates by providing procedures to store, retrieve and update data, as well as manage the available space on the device(s) which contain it.
332
questions with no upvoted or accepted answers
9
votes
2
answers
1k
views
Can Btrfs use SSD for metadata and leave bulk data on HDD?
is it possible for Btrfs to use SSD for metadata only & leave bulk data on less costly storage such as HDD? I refered to this page Using_Btrfs_with_Multiple_Devices and can not find a solution.
...
- 191
6
votes
0
answers
2k
views
Is my NFS mount actually using async? Diagnosing very slow response time
I have the following NFS mount:
server:path /mnt/path nfs rw,hard,intr,nfsvers=4,async 0 0
Pings to the server are ~60ms, which is quite reasonable, yet any access to the mount is very slow. Copying ...
- 71
6
votes
1
answer
19k
views
GlusterFS Transport endpoint not connected from time to time
I'm using GlusterFS 3.7.9, currently on a single server with 4 bricks.
Each brick has 4TB and the volume is set up as distribute only.
The volume is mounted on a secondary server and I use it for ...
- 315
5
votes
0
answers
13k
views
Mount filesystem with "structure needs cleaning" on ext4
There is a created years ago(and many time resized from that times) filesystem with ext4. After power failure it stop to mount.
When i try to mount it manually i receive an error:
# mount /dev/space/...
- 1,076
5
votes
1
answer
192
views
File locked only for Developer that tries to deploy
Our Developers work with VisualStudio 2017
They use a Post-Build PowerShell function that I wrote, to publish the application to the correct destination.
Sometimes (1 out of 100 times) they get the ...
- 787
4
votes
0
answers
108
views
Data Replication Approaches for Hot Standby Architecture
I'm relatively new to the world of storage & filesystems (please forgive me if I'm not using the correct language), and I'm currently researching ways to achieve a hot standby configuration -- i.e....
- 141
4
votes
0
answers
3k
views
Can't Disable SMB 2/3 Signing between Windows 10 and Windows Server 2019
I've been having some strange file copy issues between a Windows 10 client and Window Server 2019 system (DC/Fileserver).
I don't want to explain that issue in detail here other than to say it ...
- 71
4
votes
1
answer
2k
views
How to disable fsync on Linux
Is there a way to make fsync operations on Linux a no-op, ideally just for a single directory or mount point?
I am running some software which unfortunately I cannot modify which is doing excessive ...
- 359
4
votes
1
answer
2k
views
Linux - Disk / Filesystem as a LRU Cache (with transparent expiry)
I have a case where I'd want to use local disk as a LRU cache for (hot) files from a separate web service (something like S3). If the file doesn't exist on disk, the file is read over the internet, ...
- 151
4
votes
1
answer
550
views
Rsync takes 8+ hours to backup 15M+ files
I have ~700GB storage where I store ~15M files, hence average file size is ~50KB. To back it up, over night I run a simple rsync script with the following set of flags:
--archive --update --compress -...
- 378
4
votes
0
answers
3k
views
Grow ZFS pool to use the whole disk
What's the (if there's any) way to grow a zfs pool that only uses a disk partially to use the whole disk?
Background is, zfs is used here on a virtual machine and the Virtual machines disk has been ...
- 143
4
votes
1
answer
358
views
"Hot data" and erasure coding: how to know if it is efficiently handled?
It is well known that erasure coding adds extra complexity because of encoding and decoding operations. Due to this drawback, most of cloud services recommend to use data replication for hot data and ...
- 88
4
votes
3
answers
2k
views
Move, and split up, 5TB of data
Here is the scenario:
I have 5 TB (yes, that's a T) of files on a Windows server that I need to migrate to a new server in as short and efficient time as possible. (Think: Robocopy, Rsync, etc as I ...
- 41
4
votes
2
answers
2k
views
ESENT fails to determine the minimum I/O block size
I'm trying to get RavenDB running in embedded mode on a shared/multi-tenant webhost. RavenDB relies on the ESENT storage API. The filesystem on the hosting machines is locked down. The RavenDB ...
- 498
3
votes
0
answers
518
views
What linux distro support Host Managed HDD by file system?
According to this Seagate presentation there are some ongoing (?) efforts targeted toward modification of ext4 file system introducing SMRFS -EXT4 - support of host managed hard drives. The goal is to ...
- 131
3
votes
0
answers
115
views
ZFS missing filesystem after interrupted backup
I have two filesystems in a pool, backup/nextcloud and backup/vm. Today, after a send/receive transfer was interrupted before it could finish (I was backing stuff up to these filesystems), I no longer ...
- 31
3
votes
0
answers
560
views
df shows negative values for used
I am running Centos 7 and have an issue that the server ran out of space, was able to get in after a bad reboot and cleared temp files. Then cleared backups and server was back.
Since then I spotted ...
- 31
3
votes
0
answers
179
views
What is directory's blockmap? And how many disk I/Os will happen?
I am reading this paper from Facebook (Beaver). The paper says that
We initially stored thousands of files in each directory of an NFS
volume which led to an excessive number of disk operations ...
- 131
3
votes
0
answers
1k
views
Windows System State Analyzer 3.0 failing to compare file system snapshots
I have an issue with the Windows System State Analyzer 3.0.
The tool takes snapshots of the status of file systems, drivers, registry and services statuses, but when I try to compare those, it fails ...
- 213
3
votes
0
answers
2k
views
why my XFS file system got corrupted? root cause analysis
I have a block SAN storage volume mounted to my server via FC, I have formatted the volume with XFS.
I started experiencing file system corruption that can be easily repaired with xfs_repair, ...
- 441
3
votes
1
answer
182
views
can 'Percona MySQL Data Recovery' be used to recover dropped tables if the datadir filesystem is mounted as /
according to Percona:
Unmount the filesystem or make it read-only if...
You have filesystem corruption OR
You have dropped tables in innodb_file_per_table format
If I have innodb_file_per_table ...
- 106
3
votes
0
answers
3k
views
Recovering a VHD after resizing it using VBoxManage
I am using VirtualBox 4.1.18 and had a virtual machine running Windows 8 RC with a single VHD, which was initially sized at 25GB (too small!).
After installing the OS and some applications I ran out ...
- 815
3
votes
2
answers
1k
views
Shared block device file system (cluster file system without networking)
Is there any file system that can be mounted multiple times and supports concurrent file access for Linux? Basically I want something like a cluster file system but without the need to have a running ...
- 61
3
votes
1
answer
802
views
Gluster Read-Only file system
I'm stuck with this problem and I can't solve it, we have a website so people can upload their videos on it in some path (Temp directory for example) then our admins go and move these video to another ...
- 31
2
votes
1
answer
126
views
Azure NFS migration from on prem NFS
Context: We are working on a data migration project involving the synchronization of data between an on-premises NFS filesystem and an Azure NFS-based file share. The goal is to ensure a seamless ...
- 21
2
votes
0
answers
488
views
Data corruption after dmsetup suspend, reload, resume, and re-suspend
Consider the following series of events for a device-mapper crypt target, test, holding an ext4 filesystem. These three commands swap out the crypt target's table with a new (dummy) table. This ...
- 462
2
votes
1
answer
1k
views
How do I check a remote file systems mount permissions?
I'm mounting a test server to a shared filesystem at work. It's a cifs mount so im looking at this reference page: https://linux.die.net/man/8/mount.cifs
I want to try and mount in a "know as ...
- 121
2
votes
0
answers
1k
views
why do I get bad superblock on /dev/sda, missing codepage or helper program?
Check this:
root@dev:~# lsblk -f|grep sda
sda ext4 1.0 21ca0461-0e80-4468-b942-3735e9fd4945
root@dev:~# grep /db /etc/fstab
UUID=21ca0461-0e80-4468-b942-...
- 294
2
votes
1
answer
160
views
Unknown filesystems on RAID5 partitions
I am trying to retrieve data from NAS (Acer Altos EasyStore M2) with dead mainboard.
System in the NAS is based on CentOS 5 and some software from Falcon (FalconStore) is used.
I removed disks from ...
- 121
2
votes
1
answer
284
views
Enabling 8dot3name functionality on massive external drive
We've just switched to a new file server, but a lot of our designers are having issues with file names which are too long. We have enabled LongPathsEnabled but the issues remain specifically for Adobe ...
- 193
2
votes
1
answer
216
views
How to mount a filesystem that also has remote filesystems mounted
I am trying to create a system for our developers to be able to use libraries that MUST be retained at the client's site. We are not allowed to download these libraries to develop off locally, but ...
- 21
2
votes
2
answers
358
views
AWS XFS performance issues. Stripped setup vs single disk setup
I wanted to share an issue (I guess I may be misunderstanding some concepts) that I'm facing with some benchmarks I'm doing to XFS setups, as we are going to recently migrate a service to a new ...
- 149
2
votes
0
answers
470
views
resize2fs shrinking very slow
I tried to shrink a 60TB ext4 to 50TB and it takes about one week to finish.
I know that should take much time but it's very slow even my disks underlying are RAID0.
After some research, it seems ...
- 31
2
votes
0
answers
609
views
Single disk partial redundancy
I have a single external HDD that I'd like to use as storage for data that's not read/written very often. I'd like to make this storage resilient against faults that might occur.
ZFS apparently ...
- 416
2
votes
1
answer
488
views
How to gain privileges to resize filesystem of google cloud within CoreOS Toolbox (nspawn/docker) container?
TL;DR: Trying to resize2fs /media/root/dev/sdc within CoreOS Toolbox container fails, message open: Operation not permitted while opening /media/root/dev/sdc. Probably privilege issue, how do I gain ...
google-cloud-platform
2
votes
0
answers
89
views
Recovering a concatenated disk (ccd)
I need to recover data from an old filesystem, which was located on two small (by today's standards) drives -- using a concatenated disk driver (known as ccd in FreeBSD).
I have the drives online (no ...
- 2,387
2
votes
3
answers
503
views
Calculate folder size without counting links
I need to calculate the size of "real" files created under a folder (and its sub-folders) on an NTFS drive, where "real" is all files that are not present because of hard/soft-links, junctions etc.
...
- 121
2
votes
0
answers
317
views
Which attributes/descriptors are changed by hardlinking a file on Windows?
I'm working on a little backup script using robocopy and hardlinks. My aim is to have differential backups using similar concept as rsync's --link-dest without having to resort to 3rd party tools. For ...
- 246
2
votes
0
answers
759
views
btrfs: subvolume/snapshot tree
How do I list all subvolumes / snapshots on a btrfs filesystem in parent / child hierarchy?
I want something like the tree command for directories/files, but for parent/child subvolumes with ...
- 1,155
2
votes
2
answers
85
views
Removed ZFS files reoccurring after remount
I have a nasty situation with some of my ZFS filesystems (see list below). Files I removed therein keep reappearing after a remount (such after a reboot). One such filesystem is /root. I get an mount ...
- 31
2
votes
0
answers
596
views
Weird results of filesystem benchmark (bonnie++, VPS)
I wanted to check the performance of filesystems of my newly purchased VPS and compare it to the old one, the results surprised me though and I don't know how to analyse them.
I picked bonnie++ to ...
- 121
2
votes
1
answer
79
views
Is there a way to uniquely identify a directory on a Windows fileserver even after it has been renamed?
I'm using PowerShell scripts to manage the permissions on our fileservers. In general this works pretty well but sometimes directories are renamed. This does of course not affect the permissions but ...
- 246
2
votes
0
answers
445
views
How to encrypt data on an Ubuntu server built on RAID + LVM?
I'm managing a file server with two disks. The server is running Ubuntu 14.04, and it's already configured with software RAID1 (/dev/md0), and LVM on top of it.
Important data is stored in /var and /...
- 245
2
votes
0
answers
61
views
How to interpret the contents of /lost+found after serious filesystem corruption?
I am trying to work out whether some serious filesystem corruption is recoverable or not - however, I am struggling to find a definitive description of what i am seeing in /lost+found anywhere on the ...
2
votes
0
answers
2k
views
Can't mount BTRFS with write permissions. Btrfs check crashes (Core dumped)
I was using btrfs filesystem for some time on one of my external drives mainly to test deduplication and everything was working just fine. Unfortunately yesterday when I mounted the partition I ...
- 123
2
votes
0
answers
215
views
Windows Server: Impact of high count of ACL entries on overall performance
I have been searching on this and just can't find enough information on the topic.
We are trying to develop a custom folder / permission tool. The clients needs are quiet complicated as there will be ...
- 21
2
votes
0
answers
806
views
Constrained Delegation between IIS, SQL Server, SSRS and File System
First of all, not sure which site is best suited for this question be it SO, SF or SU so please feel free to suggest migration!
I have a requirement to constrain delegation between several machines ...
- 735
2
votes
0
answers
2k
views
What is a fast, efficient method for threading rsync
I have a single root directory (on a NAS) that I need to backup to another server. The hierarchy of the directory is several layers deep and a majority of the data is composed of extremely large ...
- 270
2
votes
1
answer
666
views
What distributed FS, with small files read / write workload perform better?
I have 2 machines sharing storage via iscsi (multipath), soon we add another one, this machines are Web app servers that read small files on shared storage ( < 256kB), and write them back. so we ...
- 51
2
votes
0
answers
3k
views
Circular directory structure
I'm having an issue with a circular directory structure warning produced by du and find on my CentOS servers.
I have two FreeNAS servers exporting several datasets via NFS which are mounted on the ...
- 163