Questions tagged [disk-space-utilization]

For questions related to disk space utilisation.

Filter by
Sorted by
Tagged with
393 votes
27 answers
477k views

How can I get the size of an Amazon S3 bucket?

I'd like to graph the size (in bytes, and # of items) of an Amazon S3 bucket and am looking for an efficient way to get the data. The s3cmd tools provide a way to get the total file size using s3cmd ...
powdahound's user avatar
  • 4,385
245 votes
17 answers
481k views

df in linux not showing correct free space after file removal

I have file servers which are used to store files. Files might reside there for a week, or for a year. Unfortunately, when I remove files from the server, df command doesn't reflect the freed up space....
user avatar
179 votes
18 answers
286k views

Disk full, du tells different. How to further investigate?

I have a SCSI disk in a server (hardware Raid 1), 32G, ext3 filesytem. df tells me that the disk is 100% full. If I delete 1G this is correctly shown. However, if I run a du -h -x / then du tells me ...
initall's user avatar
  • 2,365
127 votes
18 answers
304k views

How do you increase a KVM guest's disk space?

I setup an Ubuntu guest on a CentOS KVM host with initially 6GB of disk space. How do I go about increasing the Ubuntu guest's disk space from the command line? EDIT #1: I'm using a disk image file (...
slm's user avatar
  • 7,730
39 votes
5 answers
257k views

Centos 7 Extend partition with unallocated space

I have centos 7 server (CentOS Linux release 7.3.1611 (Core)) When I was updated my server I saw error you need extra space. But I had 20GB disk on server when I check disk spaces I saw only 4.5GB ...
kibar's user avatar
  • 493
38 votes
7 answers
51k views

How can I determine what is taking up so much space? [duplicate]

I was using df -h to print out human readable disk usage. I would like to figure out what is taking up so much space. For instance, is there a way to pipe this command so that it prints out files that ...
syn4k's user avatar
  • 579
31 votes
6 answers
4k views

Linux server out of space

I have been asked this question in two consecutive interviews, but after some research and checking with various systems administrators I haven't received a good answer. I am wondering if somebody can ...
user avatar
31 votes
7 answers
91k views

Setting Low Disk Space Alerts on Windows Server 2008

I was wondering if there is an easy way to trigger an e-mail alert on Windows Server 2008 when any logical disk partitions become low on space. I have 2 SQL servers that have come close to running ...
rmwetmore's user avatar
  • 432
29 votes
4 answers
12k views

Windows 2019: can't figure out why my drive is full

On a Windows 2019 Server the drive D: is 100% full (500 Gb used): I'm trying to understand why the disk is full but I can't because both File Explorer and Total Commander reports no more than 33 Gb ...
Mat's user avatar
  • 1,903
29 votes
8 answers
2k views

Email hoarder intervention and education - (Exchange environment)

Throughout my career, I've encountered quite a few users who were email hoarders... I'm managing a 100-user environment where users previously had 100mb quotas and a basic Cyrus IMAP/Postfix solution....
ewwhite's user avatar
  • 198k
27 votes
5 answers
62k views

how to use du to see files greater than a threshold size

I am having a few situations to which I do not see any thing in du man pages. I want to see files in a sub directory which are larger than a particular size only. I use du -sh > du_output.txt I ...
Bond's user avatar
  • 831
27 votes
7 answers
11k views

Disk usage treemap software for headless Linux

There are some programs which can display used disk space using a treemap, such as WinDirStat for Windows and KDirStat for KDE/Linux: I'm looking for something similar, but for a headless Linux box. (...
Vladimir Panteleev's user avatar
27 votes
7 answers
25k views

Easiest way to automatically check EC2 disk space and be alerted if it is running low?

Running the Amazon Linux AMI. It seems that CloudWatch does not check for free disk space. I have a number of servers and ideally don't want to have to configure each one with a mail server, script to ...
DaBeeeenster's user avatar
25 votes
9 answers
88k views

How much space should you leave free on a hard disk? [closed]

Is there a rule of thumb for how much space to leave free on a hard disk? I used to hear you should leave at least 5% free to avoid fragmentation. [I know the answer depends on usage (eg: video files ...
username's user avatar
  • 4,785
23 votes
6 answers
9k views

Best way to prevent the root system filling up when a mount fails?

We have an internal web server (virtualized, hosting ReviewBoard, but not super relevant) and we have a relatively consistent failure mode with failed NFS mounts causing / to fill up. Distro is Ubuntu ...
Peter's user avatar
  • 333
21 votes
8 answers
201k views

Cleaning up a server's C:\ drive. All known ways

I have a c:\ on a server that is filling up, most likely due to the accumulation of patches over the years. I'm told by Microsoft PSS Support that it is unwise to simply delete the compressed ...
19 votes
8 answers
30k views

Find largest directories/files recursively [duplicate]

I'm looking for a script/program which will display the top x largest directories/files and then descend into those folders and display the x largest directories/files for a configurable depth. 231MB ...
Robert Munteanu's user avatar
19 votes
11 answers
24k views

How does one find which files are taking up 80% of the space on a Linux webserver?

The drive is constantly filling up. You've hunted down all the spare and random files you can. grep'd for coredump files and even removed some of the un-needed backups... What would be your next move....
Gareth's user avatar
  • 8,583
19 votes
6 answers
75k views

How can I move /var/log directory

On our production server there is a small drive for the root mount point /, /var/log is taking too much space and I have to manually delete some files. How can I move /var/log/ to let's say /home/log ...
Razique's user avatar
  • 2,286
19 votes
4 answers
12k views

"No space left on device" error despite having plenty of space, on btrfs

Almost everywhere I'm getting failures in logs complaining about No space left on device Gitlab logs: ==> /var/log/gitlab/nginx/current <== 2016-11-29_20:26:51.61394 2016/11/29 20:26:51 [emerg]...
Austin's user avatar
  • 295
17 votes
12 answers
28k views

Determine Location of Inode Usage

I recently installed Munin on a development web server to keep track of system usage. I've noticted that the system's inode usage is climbing by about 7-8% per day even though the disk usage has ...
Dave Forgac's user avatar
  • 3,596
17 votes
7 answers
46k views

Out of disk space, what's the source?

Filesystem Size Used Avail Use% Mounted on /dev/sda1 220G 220G 0 100% / none 1.9G 168K 1.9G 1% /dev none 1.9G 0 1.9G 0% /dev/...
Moak's user avatar
  • 784
16 votes
9 answers
92k views

Disk usage per user in Linux / Unix

I need to find out how much disk space is being occupied by each user on the network. I am aware of df and du commands: I could list the entire filesystem and AWK the output, but I wonder if there is ...
Escualo's user avatar
  • 261
16 votes
9 answers
12k views

Calculating total file size by extension in shell

We have a set of directories containing lucene indexes. Each index is a mix of different file types (differentiated by extension) eg: 0/index/_2z6.frq 0/index/_2z6.fnm .. 1/index/_1sq.frq 1/index/...
barnybug's user avatar
  • 293
16 votes
5 answers
93k views

How do I recover free space on deleted files without restarting the referencing processes?

When big files are deleted on a server, the files might still be referenced by processes, so the file system doesn't have more free space. I tried to use lsof, but it seems it didn't list the deleted ...
ujjain's user avatar
  • 4,033
16 votes
3 answers
14k views

How to 're-balance' data in zfs? (Make sure the data is spread amongst all striped mirrors)

Using a striped mirror (Raid 10) as an example, if two disks are expanded to four, how can the data from the two disks be 're-balanced' (spread out) amongst the two mirrors? That is, how can the ...
Greg's user avatar
  • 1,677
16 votes
3 answers
56k views

How to check diskspace on SFTP server

Recently I encountered a lack of diskspace problem on a SFTP server and I realised I have no idea how to check how much is left or even the total amount. Does anyone know how to do this through an ...
kjetilh's user avatar
  • 261
15 votes
4 answers
21k views

After deleting a large file, how long does it take `df` to pick up the change?

I deleted a 2.3GB log file on my Ubuntu server, and df doesn't seem to be picking up the change. Is there typically a delay before df can detect that a large file has been deleted?
dan's user avatar
  • 907
15 votes
1 answer
23k views

how to set up monit to monitor disk-space

I use monit on my server to monitor apache and mysql running. Now I want to add an alert if the disk gets too full. I added this for testing in /etc/monit/monitrc: check device rootfs with path /dev/...
rubo77's user avatar
  • 2,519
14 votes
4 answers
26k views

Why after deleting a 110+ GB collection, my /var/lib/mongodb directory still have same size?

I am having some troubles with MongoDB and space usage. In particular, I once used to have a large collection of about 600 million records totaling 110+ GB on disk. Recently I decided to drop it ...
tunnuz's user avatar
  • 427
14 votes
1 answer
71k views

How do I install Disk Cleanup on Windows 2012 server without installing the Desktop Experience?

The issue is simply that I want to do the best I can to clean-up/compact a VM's .vhdx drive before running the Optimize-VHD cmdlet. It's nice to use Microsoft's Disk Cleanup utility. The problem is ...
Granger's user avatar
  • 1,160
14 votes
6 answers
36k views

Best method to track folder size growth over time?

I have a file server that has a pretty large folder tree. There's a shared folder, under that are 5 departmental folders. Nested inside of those are thousands of subfolders and files. I would like ...
Aszurom's user avatar
  • 463
13 votes
6 answers
61k views

Ubuntu - /usr is full up, recommend anything in there I can delete?

A friend of mine partitioned his ubuntu system with /usr on a separate partition. That partition is now full. He can't use apt to install new software. Is there anything in /usr that he can safely ...
Amandasaurus's user avatar
  • 32.3k
13 votes
1 answer
37k views

Elasticsearch is using way too much disk space

I have a CentOS 6.5 server on which I installed Elasticsearch 1.3.2. My elasticsearch.yml configuration file is a minimal modification of the one shipping with elasticsearch as a default. Once ...
mac's user avatar
  • 500
13 votes
2 answers
2k views

df vs du. Is my disk really full?

Strange problem... Why i have full / partition used, but it's not really used? Fast info: xwing ~ # df -h Filesystem Size Used Avail Use% Mounted on rootfs 16G 15G 75M 100% / /...
morsik's user avatar
  • 260
12 votes
4 answers
8k views

Ubuntu root drive running out of space, I can't find source through du or lsof

The root drive on an Ubuntu 15.10 machine is nearly out of space, but I can't find the source. The drive that's running out of space is sdb2, 313M of 51G available. The filesystem is ext4. Here is ...
biggvsdiccvs's user avatar
12 votes
3 answers
16k views

disk space overhead in ext4

I'd like to know if there's some rule (or formula) I can apply to find out how much of disk space will be used by the filesystem in an ext4 partition. for example, in a partition of 100 GB, how much ...
cd1's user avatar
  • 1,494
11 votes
9 answers
17k views

No free disk space [duplicate]

I have weird situation because Linux df command says that there is no free disk space [root@backup cache]# df -h Filesystem Size Used Avail Use% Mounted on /dev/sda3 72G ...
user avatar
11 votes
2 answers
21k views

Find the used hard disk data and solve disk pressure [duplicate]

I have a server which is running Ubuntu 18.04 and it is also a worker node for K8s. Sometimes I see that K8s is killing pods on this machine because of disk presseur and when I get df -h --total I can ...
AVarf's user avatar
  • 479
11 votes
4 answers
2k views

How do I most efficiently store and serve 1,000,000+ small gziped files on a Linux web server?

I have large static content that I have to deliver via a Linux-based webserver. It is a set of over one million small, gzip files. 90% of the files are less than 1K and the remaining files are at most ...
Jérôme Verstrynge's user avatar
11 votes
1 answer
11k views

Could Puppet-reports be removed once these have been processed by Puppet-dashboard or PuppetDB?

Puppet-reports are using a lot of diskspace in: /var/lib/puppet/reports /var/lib/mysql The assumption is that it stores all reports in the MySQL database, because both paths are about the same size. ...
ujjain's user avatar
  • 4,033
11 votes
8 answers
3k views

Disk quota tab not shown for all hard drives in Windows Server SBS 2003

I have got a new job and the existing SBS 2003 domain setup is unsecure (i.e. everyone is a domain admin etc etc). There are lots of problem due to inexperienced "network admin", and I am trying to ...
deddebme's user avatar
  • 161
10 votes
3 answers
30k views

How do I find out what is using up all the space on my / partition?

I am on a large instance on Amazon's EC2 servers. I run the df command and get: root@db:~# df -h Filesystem Size Used Avail Use% Mounted on /dev/sda1 9.9G 9.1G 284M 98% / ...
sheats's user avatar
  • 203
10 votes
3 answers
7k views

calculating days until disk is full

We use graphite to track history of disk utilisation over time. Our alerting system looks at the data from graphite to alert us when the free space falls below a certain number of blocks. I'd like to ...
Capt. Crunch's user avatar
10 votes
1 answer
5k views

No space left on device -- but there is space

I'm running an Ubuntu 12.04.1 server in a VMware virtualized environment that has a strange issue. Twice now, at seemingly random times, the machine has suddenly been unable to write to the root ...
Moduspwnens's user avatar
10 votes
2 answers
21k views

How can I eliminate the huge, cached MSI files in C:\Windows\Installer?

The size of the MSI cache folder (C:\Windows\Installer) has grown substantially, and is now taking up way too much disk space on my (domain) computers. Can this folder be eliminated or shrunk? Same ...
Stein Åsmul's user avatar
  • 2,771
10 votes
2 answers
290 views

No more diskspace on server [duplicate]

after some wrong php code was exceuted on one of our servers, which tried to open up a file which didn't exist, we ended up with huge apache log files which weren't configured yet to rotate. We just ...
latz's user avatar
  • 201
9 votes
5 answers
73k views

Is there a Windows equivalent to the Unix du command? [duplicate]

Possible Duplicates: What are good tools to show disk usage (for Windows)? How to determine a disk consuming service in Windows 2008 server? I am troubleshooting performance on a PC with (...
Frank's user avatar
  • 193
9 votes
5 answers
16k views

how to make `atop` create less log files?

Currently I have like 3.5GB of atop log files at /var/log/atop/ I do not need that much log data. Files there are as old as 28 days ago. I cannot find a way to configure atop log limit/quota/age. ...
Aquarius Power's user avatar
9 votes
3 answers
8k views

Web-based disk space visualizer

I have a number of Linux webservers for which I'd like to track where disk space is going and keep disk space to a minimum. Typically I login on SSH and use du to find out where disk space is wasted ...
Martijn's user avatar
  • 356

1
2 3 4 5
13