Questions tagged [disk-space-utilization]
For questions related to disk space utilisation.
612
questions
393
votes
27
answers
477k
views
How can I get the size of an Amazon S3 bucket?
I'd like to graph the size (in bytes, and # of items) of an Amazon S3 bucket and am looking for an efficient way to get the data.
The s3cmd tools provide a way to get the total file size using s3cmd ...
245
votes
17
answers
481k
views
df in linux not showing correct free space after file removal
I have file servers which are used to store files. Files might reside there for a week, or for a year. Unfortunately, when I remove files from the server, df command doesn't reflect the freed up space....
179
votes
18
answers
286k
views
Disk full, du tells different. How to further investigate?
I have a SCSI disk in a server (hardware Raid 1), 32G, ext3 filesytem. df tells me that the disk is 100% full. If I delete 1G this is correctly shown.
However, if I run a du -h -x / then du tells me ...
127
votes
18
answers
304k
views
How do you increase a KVM guest's disk space?
I setup an Ubuntu guest on a CentOS KVM host with initially 6GB of disk space. How do I go about increasing the Ubuntu guest's disk space from the command line?
EDIT #1: I'm using a disk image file (...
39
votes
5
answers
257k
views
Centos 7 Extend partition with unallocated space
I have centos 7 server (CentOS Linux release 7.3.1611 (Core)) When I was updated my server I saw error you need extra space. But I had 20GB disk on server when I check disk spaces I saw only 4.5GB ...
38
votes
7
answers
51k
views
How can I determine what is taking up so much space? [duplicate]
I was using df -h to print out human readable disk usage. I would like to figure out what is taking up so much space. For instance, is there a way to pipe this command so that it prints out files that ...
31
votes
6
answers
4k
views
Linux server out of space
I have been asked this question in two consecutive interviews, but after some research and checking with various systems administrators I haven't received a good answer. I am wondering if somebody can ...
31
votes
7
answers
91k
views
Setting Low Disk Space Alerts on Windows Server 2008
I was wondering if there is an easy way to trigger an e-mail alert on Windows Server 2008 when any logical disk partitions become low on space. I have 2 SQL servers that have come close to running ...
29
votes
4
answers
12k
views
Windows 2019: can't figure out why my drive is full
On a Windows 2019 Server the drive D: is 100% full (500 Gb used):
I'm trying to understand why the disk is full but I can't because both File Explorer and Total Commander reports no more than 33 Gb ...
29
votes
8
answers
2k
views
Email hoarder intervention and education - (Exchange environment)
Throughout my career, I've encountered quite a few users who were email hoarders...
I'm managing a 100-user environment where users previously had 100mb quotas and a basic Cyrus IMAP/Postfix solution....
27
votes
5
answers
62k
views
how to use du to see files greater than a threshold size
I am having a few situations to which I do not see any thing in du man pages.
I want to see files in a sub directory which are larger than a particular size only.
I use du -sh > du_output.txt I ...
27
votes
7
answers
11k
views
Disk usage treemap software for headless Linux
There are some programs which can display used disk space using a treemap, such as WinDirStat for Windows and KDirStat for KDE/Linux:
I'm looking for something similar, but for a headless Linux box. (...
27
votes
7
answers
25k
views
Easiest way to automatically check EC2 disk space and be alerted if it is running low?
Running the Amazon Linux AMI. It seems that CloudWatch does not check for free disk space. I have a number of servers and ideally don't want to have to configure each one with a mail server, script to ...
25
votes
9
answers
88k
views
How much space should you leave free on a hard disk? [closed]
Is there a rule of thumb for how much space to leave free on a hard disk? I used to hear you should leave at least 5% free to avoid fragmentation.
[I know the answer depends on usage (eg: video files ...
23
votes
6
answers
9k
views
Best way to prevent the root system filling up when a mount fails?
We have an internal web server (virtualized, hosting ReviewBoard, but not super relevant) and we have a relatively consistent failure mode with failed NFS mounts causing / to fill up. Distro is Ubuntu ...
21
votes
8
answers
201k
views
Cleaning up a server's C:\ drive. All known ways
I have a c:\ on a server that is filling up, most likely due to the accumulation of patches over the years.
I'm told by Microsoft PSS Support that it is unwise to simply delete the compressed ...
19
votes
8
answers
30k
views
Find largest directories/files recursively [duplicate]
I'm looking for a script/program which will display the top x largest directories/files and then descend into those folders and display the x largest directories/files for a configurable depth.
231MB ...
19
votes
11
answers
24k
views
How does one find which files are taking up 80% of the space on a Linux webserver?
The drive is constantly filling up. You've hunted down all the spare and random files you can. grep'd for coredump files and even removed some of the un-needed backups...
What would be your next move....
19
votes
6
answers
75k
views
How can I move /var/log directory
On our production server there is a small drive for the root mount point /,
/var/log is taking too much space and I have to manually delete some files.
How can I move /var/log/ to let's say /home/log ...
19
votes
4
answers
12k
views
"No space left on device" error despite having plenty of space, on btrfs
Almost everywhere I'm getting failures in logs complaining about No space left on device
Gitlab logs:
==> /var/log/gitlab/nginx/current <==
2016-11-29_20:26:51.61394 2016/11/29 20:26:51 [emerg]...
17
votes
12
answers
28k
views
Determine Location of Inode Usage
I recently installed Munin on a development web server to keep track of system usage. I've noticted that the system's inode usage is climbing by about 7-8% per day even though the disk usage has ...
17
votes
7
answers
46k
views
Out of disk space, what's the source?
Filesystem Size Used Avail Use% Mounted on
/dev/sda1 220G 220G 0 100% /
none 1.9G 168K 1.9G 1% /dev
none 1.9G 0 1.9G 0% /dev/...
16
votes
9
answers
92k
views
Disk usage per user in Linux / Unix
I need to find out how much disk space is being occupied by each user on the network. I am aware of df and du commands: I could list the entire filesystem and AWK the output, but I wonder if there is ...
16
votes
9
answers
12k
views
Calculating total file size by extension in shell
We have a set of directories containing lucene indexes. Each index is a mix of different file types (differentiated by extension) eg:
0/index/_2z6.frq
0/index/_2z6.fnm
..
1/index/_1sq.frq
1/index/...
16
votes
5
answers
93k
views
How do I recover free space on deleted files without restarting the referencing processes?
When big files are deleted on a server, the files might still be referenced by processes, so the file system doesn't have more free space.
I tried to use lsof, but it seems it didn't list the deleted ...
16
votes
3
answers
14k
views
How to 're-balance' data in zfs? (Make sure the data is spread amongst all striped mirrors)
Using a striped mirror (Raid 10) as an example, if two disks are expanded to four, how can the data from the two disks be 're-balanced' (spread out) amongst the two mirrors?
That is, how can the ...
16
votes
3
answers
56k
views
How to check diskspace on SFTP server
Recently I encountered a lack of diskspace problem on a SFTP server and I realised I have no idea how to check how much is left or even the total amount.
Does anyone know how to do this through an ...
15
votes
4
answers
21k
views
After deleting a large file, how long does it take `df` to pick up the change?
I deleted a 2.3GB log file on my Ubuntu server, and df doesn't seem to be picking up the change. Is there typically a delay before df can detect that a large file has been deleted?
15
votes
1
answer
23k
views
how to set up monit to monitor disk-space
I use monit on my server to monitor apache and mysql running.
Now I want to add an alert if the disk gets too full. I added this for testing in /etc/monit/monitrc:
check device rootfs with path /dev/...
14
votes
4
answers
26k
views
Why after deleting a 110+ GB collection, my /var/lib/mongodb directory still have same size?
I am having some troubles with MongoDB and space usage. In particular, I once used to have a large collection of about 600 million records totaling 110+ GB on disk. Recently I decided to drop it ...
14
votes
1
answer
71k
views
How do I install Disk Cleanup on Windows 2012 server without installing the Desktop Experience?
The issue is simply that I want to do the best I can to clean-up/compact a VM's .vhdx drive before running the Optimize-VHD cmdlet. It's nice to use Microsoft's Disk Cleanup utility. The problem is ...
14
votes
6
answers
36k
views
Best method to track folder size growth over time?
I have a file server that has a pretty large folder tree. There's a shared folder, under that are 5 departmental folders. Nested inside of those are thousands of subfolders and files.
I would like ...
13
votes
6
answers
61k
views
Ubuntu - /usr is full up, recommend anything in there I can delete?
A friend of mine partitioned his ubuntu system with /usr on a separate partition. That partition is now full. He can't use apt to install new software. Is there anything in /usr that he can safely ...
13
votes
1
answer
37k
views
Elasticsearch is using way too much disk space
I have a CentOS 6.5 server on which I installed Elasticsearch 1.3.2.
My elasticsearch.yml configuration file is a minimal modification of the one shipping with elasticsearch as a default. Once ...
13
votes
2
answers
2k
views
df vs du. Is my disk really full?
Strange problem...
Why i have full / partition used, but it's not really used?
Fast info:
xwing ~ # df -h
Filesystem Size Used Avail Use% Mounted on
rootfs 16G 15G 75M 100% /
/...
12
votes
4
answers
8k
views
Ubuntu root drive running out of space, I can't find source through du or lsof
The root drive on an Ubuntu 15.10 machine is nearly out of space, but I can't find the source. The drive that's running out of space is sdb2, 313M of 51G available. The filesystem is ext4.
Here is ...
12
votes
3
answers
16k
views
disk space overhead in ext4
I'd like to know if there's some rule (or formula) I can apply to find out how much of disk space will be used by the filesystem in an ext4 partition. for example, in a partition of 100 GB, how much ...
11
votes
9
answers
17k
views
No free disk space [duplicate]
I have weird situation because Linux df command says that there is no free disk space
[root@backup cache]# df -h
Filesystem Size Used Avail Use% Mounted on
/dev/sda3 72G ...
11
votes
2
answers
21k
views
Find the used hard disk data and solve disk pressure [duplicate]
I have a server which is running Ubuntu 18.04 and it is also a worker node for K8s. Sometimes I see that K8s is killing pods on this machine because of disk presseur and when I get df -h --total I can ...
11
votes
4
answers
2k
views
How do I most efficiently store and serve 1,000,000+ small gziped files on a Linux web server?
I have large static content that I have to deliver via a Linux-based webserver. It is a set of over one million small, gzip files. 90% of the files are less than 1K and the remaining files are at most ...
11
votes
1
answer
11k
views
Could Puppet-reports be removed once these have been processed by Puppet-dashboard or PuppetDB?
Puppet-reports are using a lot of diskspace in:
/var/lib/puppet/reports
/var/lib/mysql
The assumption is that it stores all reports in the MySQL database, because both paths are about the same size. ...
11
votes
8
answers
3k
views
Disk quota tab not shown for all hard drives in Windows Server SBS 2003
I have got a new job and the existing SBS 2003 domain setup is unsecure (i.e. everyone is a domain admin etc etc). There are lots of problem due to inexperienced "network admin", and I am trying to ...
10
votes
3
answers
30k
views
How do I find out what is using up all the space on my / partition?
I am on a large instance on Amazon's EC2 servers. I run the df command and get:
root@db:~# df -h
Filesystem Size Used Avail Use% Mounted on
/dev/sda1 9.9G 9.1G 284M 98% /
...
10
votes
3
answers
7k
views
calculating days until disk is full
We use graphite to track history of disk utilisation over time. Our alerting system looks at the data from graphite to alert us when the free space falls below a certain number of blocks.
I'd like to ...
10
votes
1
answer
5k
views
No space left on device -- but there is space
I'm running an Ubuntu 12.04.1 server in a VMware virtualized environment that has a strange issue. Twice now, at seemingly random times, the machine has suddenly been unable to write to the root ...
10
votes
2
answers
21k
views
How can I eliminate the huge, cached MSI files in C:\Windows\Installer?
The size of the MSI cache folder (C:\Windows\Installer) has grown substantially, and is now taking up way too much disk space on my (domain) computers. Can this folder be eliminated or shrunk?
Same ...
10
votes
2
answers
290
views
No more diskspace on server [duplicate]
after some wrong php code was exceuted on one of our servers, which tried to open up a file which didn't exist, we ended up with huge apache log files which weren't configured yet to rotate. We just ...
9
votes
5
answers
73k
views
Is there a Windows equivalent to the Unix du command? [duplicate]
Possible Duplicates:
What are good tools to show disk usage (for Windows)?
How to determine a disk consuming service in Windows 2008 server?
I am troubleshooting performance on a PC with (...
9
votes
5
answers
16k
views
how to make `atop` create less log files?
Currently I have like 3.5GB of atop log files at
/var/log/atop/
I do not need that much log data.
Files there are as old as 28 days ago.
I cannot find a way to configure atop log limit/quota/age.
...
9
votes
3
answers
8k
views
Web-based disk space visualizer
I have a number of Linux webservers for which I'd like to track where disk space is going and keep disk space to a minimum.
Typically I login on SSH and use du to find out where disk space is wasted ...