A file system (or filesystem) is a means to organize data expected to be retained after a program terminates by providing procedures to store, retrieve and update data, as well as manage the available space on the device(s) which contain it.

learn more… | top users | synonyms (1)

3
votes
1answer
72 views

Rsync takes 8+ hours to backup 15M+ files

I have ~700GB storage where I store ~15M files, hence average file size is ~50KB. To back it up, over night I run a simple rsync script with the following set of flags: --archive --update --compress ...
3
votes
1answer
480 views

Move, and split up, 5TB of data

Here is the scenario: I have 5 TB (yes, that's a T) of files on a Windows server that I need to migrate to a new server in as short and efficient time as possible. (Think: Robocopy, Rsync, etc as I ...
3
votes
1answer
57 views

what exactly does fsck do under the covers (for UFS)?

If a computer crashes then the filesystem is an inconsistent state. What exactly is fsck(8) doing to restore to a usable filesystem? Is there a backup table? Is it cross-checking metadata? ...
3
votes
1answer
387 views

How to organize millions of static files to serve efficiently over the web?

I'd like to create a service to serve several hundred thousand smaller files (from 5kb to 500kb, mostly around 10-100kb). Think of it as a kind of gravatar.com which serves those little avatar pics on ...
2
votes
1answer
97 views

What does sunit=0 and swidth=0 mean for XFS file system?

I created an XFS file system using default parameters at the time of creation of a system. Now looking at the output of xfs_info, it show 0 for the values of sunit and swidth. I can't seem to find ...
2
votes
1answer
424 views

Why can't a GPT partitioned disk on SATA be read on USB?

If I GPT partition a 4TB disk when it is connected to SATA, then it works fine. If I take the disk and put in the an USB3 enclosure, then I get [root@localhost liveuser]# sfdisk /dev/sdb sfdisk: ...
2
votes
1answer
113 views

“Hot data” and erasure coding: how to know if it is efficiently handled?

It is well known that erasure coding adds extra complexity because of encoding and decoding operations. Due to this drawback, most of cloud services recommend to use data replication for hot data and ...
2
votes
1answer
47 views

Filesystem on a block device that now has another name?

Here's the scenario: I'm attaching a disk to a KVM guest VM, lets say 'vdb' Now I create a partition on 'vdb' and format it as ext4 (vdb1) I mount 'vdb1' and write some data I unmount the 'vdb1' I ...
2
votes
1answer
82 views

Using Volume Shadow Copy to Identify Updated Files

I have folders in my server with over 60GBs of data across ~160,000+ files. The files in this folder change regularly. I need to be able to make a backup copy of the files in this folder at a given ...
2
votes
1answer
144 views

IIS 7 - Windows Server 2008 combine to make file locked, causing IIS to overload

I have this issue where approximately once a year, one of my images in my asp.net web app becomes locked. By locked I mean you can't read/write/delete it, and if you try to, your remote machine ...
2
votes
1answer
257 views

In linux and solaris, what is the UUID based off of?

If you run dmidecode|grep UUID you are given a "globally unique string of characters" which can be used for licensing purposes. In linux, the format is usually something like this: ...
2
votes
1answer
723 views

How can I repair dir total-size with gluster self-heal

I build a glusterfs cluster, and the type is the Striped Replicated Volumes with 4 servers like that: Volume Name: test-volume Type: Striped-Replicate Volume ID: bdb596e6-a7d2-44a4-8791-1b4fdc57469c ...
2
votes
1answer
523 views

DRBD keeps crashing over saturated link

Under high I/O DRBD will crash and take server down; is there anyway to optimize DRBD to prevent from happening again. listed below is my current config, errors and specs. if you need any more ...
2
votes
1answer
74 views

Does exists a tool for monitoring which files changes?

does exists a tool to monitor how many, and which files are changed day by day ? I would like to 'monitor' how many Mbyte /Gbyte of data changes in my company file server day by day for a 'remote' ...
2
votes
1answer
125 views

Better folder structure for 1-6mil files?

I'm doing a bit of development work for a start up, and have been asked to work on the directory structure for all the content being served and the scalability of the host servers(load balancing, ...
2
votes
1answer
843 views

Recommended technology for layered disk cache in linux

I originally asked this on superuser but it occurs to me it's more more of a server topic. I've just bought a 6-core Phenom with 16G of RAM. I use it primarily for compiling and video encoding (and ...
1
vote
1answer
16 views

Dir size increases after rsyncing to a different machine with same configuration

Have a MySQL (percona, 14.14 Distrib 5.6.28-76.1) machine with a 1TB SSD hosting around 712Gb of mysql data. MySQL has 4 databases, with, say database1, taking major space, 656Gb. Lets call this ...
1
vote
1answer
114 views

Slow file io performance after large network copy on Win7

In a step of our build process we run a tool that generates about 125,000 files. When generation is complete we copy them up to a network share so other systems can copy them down to process further. ...
1
vote
1answer
114 views

What distributed FS, with small files read / write workload perform better?

I have 2 machines sharing storage via iscsi (multipath), soon we add another one, this machines are Web app servers that read small files on shared storage ( < 256kB), and write them back. so we ...
1
vote
1answer
92 views

CorrectFilePaths (or alternative) for Server 2008

I have a server with Windows Server 2008 R2 installed, and a third party application that handles all our business transactions. The problem is, we're running out of space, and the root folder for the ...
1
vote
1answer
311 views

File Lock on Windows Server

I have a shared excel file stored on a server that continually results in "This file is locked by "another user". Do you want to open as read-only?". This is on a Windows 2003 R2 Server and has had ...
1
vote
1answer
139 views

Rename NTFS file to eliminate multiple periods via batch

I at wits end trying to rename NTFS files that have technically legal, but problematic multiple periods in my Windows 2012 Server share Files are dropped in a share that look like this: ...
1
vote
1answer
653 views

MongoDB: insert operation fails but disk is free

I've seen the strange behavior of my server and first of all I looked at log file /var/log/mongodb/mongodb.log. There I saw the next lines: Wed Jan 7 16:33:31 [FileAllocator] allocating new datafile ...
0
votes
0answers
11 views

Get direct block addresses - Sleuth kit - XEN

I am using sleuth kit library in order to write an introspection tool for XEN hypervisor and my question is if we have the inode number of a file on a disk [ guest VM - ext4 filesystem], for example ...
0
votes
0answers
85 views

Xenserver 6.5 Live Storage Migration

In my xenserver environment I have an LVM over ISCSI storage repository (SR) and I have another SR which is an NFS share setup on a synology server. To be clear, all servers are in one resource pool. ...
0
votes
0answers
82 views

Is there any default time-out for file locks on Windows network shares?

Sometimes it happens that I want to rename/delete a file on a network share, but Windows tells me that the file is currently in use, even if I know that nobody else is accessing that file. After ...
0
votes
0answers
86 views

How can i sync exist files on brick to new brick with replication in glusterfs?

I successfully installed glusterfs and set up 'Replicate' on 2 servers sudo gluster peer probe $NODE1_DNS; sudo gluster volume create file_store replica 2 transport tcp $NODE1_DNS:/brick1 ...
0
votes
0answers
46 views

using testdisk to restore old superblock, cryptowall3.0 restoration

I have a drive that was infected with cryptowall3.0 Documentation states that the file is deleted and then from memory a new file is encrypted and that memory file is rename. Hypothetically restoring ...
0
votes
0answers
158 views

Usage of overlayfs

I do host websites and need the ability to give people a staging area of their current site. Since sites can get pretty big I had a look at overlayfs. The idea is to create and overlayed folder on top ...
0
votes
0answers
49 views

After installing a new disk, can't use old mount points on linux

So, I'm stumped on this one. I have functionally two volume groups. vgold and vgnew, and I migrated the lvms from the old one to the new one (via rsync of the files to an external drive first, not ...
0
votes
0answers
168 views

Why is it not possible to mount a replicated gluster volume with one Gluster server?

I am running 2 glusterd on individual machines connected by private network. It apears that I can only mount the bricks if both deamons are up, otherwise it failes. As I am pretty new to glusterfs, ...
0
votes
0answers
85 views

File writes stall during heavy disk I/O on Linux box

I have two processes running on my box => A and B. Whenever there is heavy disk I/O activity caused by writing large files to the disk by process A, I see that file writes in process B are stalling ...
0
votes
0answers
24 views

Filesystem benchmark read tests

I am benchmarking my filesystem which is ext3 and I made few tests with program hdparm. To be exact I conducted hdparm /dev/sda4 -t test (/dev/sda4 is my ext3 partition). And I got results with ...
0
votes
0answers
62 views

Mounting a remote filesystem using v9fs (client) and u9fs(server) does not give me write permissions

I am trying to mount a 9p filesystem on a linux client machine running v9fs as the 9p client with the following command sudo mount -t 9p -o ...
0
votes
0answers
146 views

Proxmox-Server: Extremely high load during deletion-task of old backups

I'm using Proxmox to get some VPS. In Proxmox I set up some backup-tasks which are running fine. BUT: The backups are stored in big files (each backup has round about 300GB) so I can not store more ...
0
votes
0answers
101 views

How to prevent users from creating long paths

Long file paths cause real problems when need to move/copy or delete large amount of data that the path is 350 character long (max character allowed by Windows is 256) I was wondering if anyone knows ...
0
votes
0answers
32 views

Not recognizing path to credentials on fstab

I'm trying to mount a remote filesystem with fstab, and using a credentials file to load the username and password, but for some reason I get this error message when I try to use # mount -a: mount ...
0
votes
0answers
45 views

Save cache folder on seperate partition with superfast filesystem?

I'm reading about disks, partitions, filesystems, recovery. I have a lack of knowledge about them. To learn things I mentally model abstract situations. So, imagine... I have the ubuntu server with ...
0
votes
0answers
43 views

Restore shows tape volume error

I have used the below command to take dump on my RHEL server: /sbin/dump -0uz -f /data0101/backup_labeir1/labeir1_150622_123050_^apps.dmp /apps The dump is successful, but when I do a restore using ...
0
votes
0answers
423 views

How to repair multiply-claimed blocks?

I get a lot of the following logs in dmesg: [26159.277230] EXT4-fs error (device sdb1): ext4_iget:3875: inode #394497188: comm mv: bad extended attribute block 22794025699896 [26219.914802] EXT4-fs ...
0
votes
0answers
158 views

How to manage permissions on shared filesystem in Linux and export it on Windows?

It is a bit complex scenario so I will try to make this a simple as possible for you. ENVIRONMENT I have a shared filesystem on Linux which I export on Windows using Samba4 and users which belong to ...
0
votes
0answers
31 views

Order of execution: First file system, then array vs. first array, then file system

Suppose I have two HDDs, same manufacturer, same model, same attributes (volume, speed, cache, ...). Both are equally partitioned. I want to have a level one array of two disks with one ext4 ...
0
votes
0answers
197 views

Dealing/Fixing the Ploop issue with OpenVZ — relclaiming lost space

So OpenVZ Ploop has a bug where if users add then delete files the space becomes unclaimed and the disk eventually runs out of space. Now there is a script that fixes that(included below). However, ...
0
votes
0answers
56 views

KVM Image consumes more space on disk than what du shows

I have a kvm image which by looking at it with du -sh consumes 13GB (12980888) but in reality it consumes 42GB. Found that out the hard way when I scped it and after 18GB it was still copying ...
0
votes
0answers
145 views

Linux filesystem ext4 fragmentation

I have a question about the filesystem ext4 and disk fragmentation: Does ext4 place files in the same directory near or next to each other on the disk? And if so how is it fragmented, for example is ...
0
votes
0answers
416 views

AIX JFS2 I/O performance problems

I have a fresh installation of AIX 7.1. I noticed that JFS2 file system with logging enabled (log=/dev/hd8) is dramatically slower than one with log=NULL. Simple zip archive extraction takes 5 minutes ...
0
votes
0answers
200 views

RAID5, unknown filesystem and disk failure

I have an Ubuntu 12.04 machine with 3 disks in RAID5, and the RAID controller is on the motherboard. After almost a year of flawless use, it seems that one disk had a failure. Every time I restarted ...
0
votes
0answers
168 views

Linux Kernel messages in log - disk write seems to be hanging on database

I was having database issues whereby commits were not completing (PostgreSQL) and it seems to be related to these messages that are filling up my server log: Jan 30 02:29:45 server001 kernel: ...
0
votes
0answers
52 views

Deleting a large error log file

We have a few PHP sites running on a windows server that are generating errors in the c:\windows\temp directory under a single log file. This file is nearly 30gb at this point. When I try to list the ...
-1
votes
0answers
8 views

Pool remote file shares into single volume

I have multiple file shares available to use as backup storage. Each one can be mounted over CIFS/NFS. Instead of mounting them all individually and trying to manage what files are stored on each one, ...