I have a CentOS 5.5 box with a seperate partition for /home. df -h
shows it at 100% usage. df -i
shows tons of free inodes. du -sh /home /home*
shows that there are about 100MB worth of files in /home. lsof -n|grep /home shows no open files in /home. lsof -n|grep deleted shows no files touching /home.
The partition is shared out via NFS and is mounted on two other CentOS 5.5 clients. lsof -n|grep /home
and lsof -n|grep deleted
show no files for for /home
or /
.
When I unmount and remount the partition, disk usage drops from 100% to less than 3%. However the disk usage is back at 100% within a few days.
The only things using /home are NFSd, a custom script, and SSHd. This script moves files from /home/somedir
to /home/tmp
, then moves the files to /tmp, then parses the files. This script runs on all three boxes.
New files are placed in /home by a script that SCPs the files into a chroot envoriment setup in /home
. Only a couple binaries plus a /dev/null
node are in /home/somepath/...
.
I have used service nfs stop
and service portmap stop
to stop nfs, stopped sshd, validated that the script mentioned above isn't running, and then checked disk usage. It remains at 100%. Only unmounting and remounting it seems to clear it up.
An fsck -f of /home (while unmounted of course) shows that the file system is fine.
All boxes are fully updated and running CentOS 5.5.
Where is my disk space going?