Questions tagged [oom]
Linux Out-of-memory Killer
0
votes
0answers
24 views
On Ubuntu, process disappears with no OOM kill record in syslog
I have a Java server process that keeps disappearing on me. I suspected an out-of-memory kill, because it is a small server (only 1GB RAM), but there is nothing in /var/log/syslog about any OOM ...
1
vote
0answers
37 views
Linux out of memory killer kills process when there is more than enough memory available
We are running a 64-Bit Ubuntu and our 32GB of physical memory is split into 3 zones (DMA: 16MB, DMA32: 4GB and Normal: 30GB). According to the dmesg logs printed below our system ran out of free ...
0
votes
1answer
16 views
OOM kills a process while there is still a lot of available memory
I am aware that there are many threads like this one, but none of them actually give a methodology on how to read an OOM message.
I have a db that is being monitored through NRPE for available ...
1
vote
1answer
116 views
Java application gets killed in kubernetes while the resource limits and heap size are specified
Background
A spring boot Java application is deployed in a kubernetes cluster and gets killed several times per day.
I'm using openjdk:8u181-jre for my Java apps.
Kubernetes version: v1.11.5
Node ...
0
votes
2answers
486 views
Enough memory but OOM killer invoked?
It has been a long time since my old friend the OOM killer came to visit me. Now it is coming by once a week and I cannot figure out why it’s triggered. It doesn’t seem that I’m missing memory. What ...
4
votes
2answers
103 views
Out of memory at 18% usage : where the ram goes?
This is related to : Out of memory at 72% usage
It looks to be the same problem but the question is slightly different : Where my memory goes ? I have 18% memory usage and my OOM Killer is killing ...
3
votes
2answers
384 views
Linux OOM-killer acting despite plenty available memory
Once a week or so the OOM-killer shoots down a postgres process in my server, despite that 'free' states it has plenty of available memory.
I have read several threads here and there, but cant see ...
1
vote
0answers
183 views
OOM killer kills process though page cache is never evicted
Our servers in production sometimes under load runs into the following issue (Linux 4.10):
Application handling the load (webserver) is running at high load.
A new job starts (e.g. cron). This ...
1
vote
0answers
1k views
“bash: fork: Cannot allocate memory” for any command - how to prevent this at OS level?
I was testing how an Ubuntu 16.04 machine handles low memory conditions and had several suspended jobs that that used up almost all the RAM on the server. I was still able to run normal bash commands ...
1
vote
1answer
439 views
Linux OOM: Trying to understand memory statistics / mismatch with expected values
I am trying to understand why the OOM killer has reaped a process on a KVM virtual machine running with 1 gigabyte of memory. While I do already know that running Linux machines without swap is not ...
0
votes
0answers
267 views
Is there any legitimate reason to mlock all of a process's mmaped files?
I'm administering some Linux servers that are running an httpd based application developed by one of our apps teams. This is in EC2 and each host has 32GB of RAM. I've noticed that there is about once ...
3
votes
2answers
3k views
Long page allocation stalls on Linux – why does this happen?
I have a problem (which I can reliably reproduce) on a bunch of Linux hosts, where the system becomes completely unresponsive after a process aggressively consumes memory. I see things like this in ...
1
vote
2answers
308 views
GKE's Container-Optimized OS Out-Of-Memory freezes
I have issue with Container-Optimized OS on GKE. If I run this simple command https://pastebin.com/raw/0WPAnAzn to consume all the RAM, at some point host freezes and doesn't respond to anything. ...
google-compute-engine
0
votes
1answer
211 views
Number of httpd processes and prefork.c
Hi I got OOM killer problems which caused:
[mpm_prefork:error] [pid 18103] (12)Cannot allocate memory: AH00159: fork: Unable to fork new process
I had to restart the server to get it working.
In /...
0
votes
1answer
373 views
VmRSS used to only about 25%, yet oom-killer strikes
I have a dedicated MySQL server equipped with 128 GB RAM. MySQL recently gets killed by the oom-killer, although MySQL is configured to use 95 GB in the worst case. In my research I came across this:
...
0
votes
1answer
3k views
Ansible throws an “ ERROR! A worker was found in a dead state ” error
When I run a playbook that simply copies a directory from one place to another, ansible throws
ERROR! A worker was found in a dead state
Error. After some googling, it looks like this is caused by ...
1
vote
1answer
3k views
OOM killer invoked despite tons of memory available? [duplicate]
I have a server where the OOM killer has been invoked once or twice almost each night since two weeks ago. The server should have more than enough memory it could free (cache/buffers, inactive_file ...
9
votes
1answer
4k views
Linux process killed even though enough memory available
I am investigating why two of our processes were killed by the Linux OOM killer - even though there seems to have been enough RAM and plenty of SWAP available at both times.
When I interpret it as by ...
2
votes
2answers
1k views
Slab reclaimable memory is not freed when needed
Correct me if I am wrong, but to my understanding slab reclaimable holds cached kernel objects which can be freed if needed. So if application needs to allocate more space, even if the 'free' memory ...
0
votes
1answer
274 views
OOM Killer on xenserver - 2832MB memory free - killing xapi
I am trying to understand why OOM killer starts killing processes when there is plenty of memory free on the server:
Result of uname -a:
Linux hostname 2.6.32.43-0.4.1.xs1.8.0.835.170778xen #1 SMP ...
1
vote
0answers
72 views
ec2 not connecting on public IP after volume resize
I am hosting two Wordpress sites on two different AWS EC2 micro instances running LAMP.
I have been getting OOM kills and decided to resize the instances to small.
Since increase the size of the ...
9
votes
2answers
2k views
Baffling Memory leak. What is using ~10GB of memory on this system?
After running for about 18 hours, this system is using ~10GB of memory, causing the OOM-killer to be triggered when we run our usual tasks:
# free -h
total used free ...
0
votes
2answers
381 views
Linux - Logging process list during high memory usage
I'm trying to diagnose occasional spikes in memory usage on a Linux server. If the spikes are high enough the OOM Killer kicks in, which results in /var/log/messages containing a useful dump of the ...
2
votes
1answer
408 views
Adjust oom_score at process launch
I've got a few servers that have begun oom-killing their backup processes and, while I understand that encountering the oom condition is quite bad in itself, I need this process to not die so that ...
2
votes
3answers
917 views
AWS WordPress site - OOM kills Apache
This question was originally asked on StackOverflow.com, and I've duplicated it to the more appropriate ServerFault.com site. The original question, which I've voted to close, can be found here
I ...
1
vote
1answer
379 views
How can there ever be an OOM scenario on Linux (heuristics behind OOM killer)?
I am aware of the concept of virtual memory. And with demand paging (depending on vm.overcommit_memory) you are able to allocate more memory than available RAM. Unless you "touch" a page nothing ...
1
vote
1answer
278 views
HaProxy suddenly crashing on new Ubuntu Images (same config works elsewhere)
I have been using HAProxy for about two years with the same working configuration. I've installed HaProxy multiple times over the last week on Ubuntu 14.04, 15.10 and I am getting out of Memory ...
28
votes
6answers
18k views
How to get the Linux OOM killer to not kill my process?
How do I get the Linux OOM killer to not kill my processes when physical memory is low but there is plenty of swap space?
I have disabled OOM killing and overcommit with sysctl vm.overcommit_memory=2....
1
vote
1answer
373 views
OOM score adjustements
On Ubuntu 12.04/Java 1.7
I have been reading/searching about OOM killer and generally understood what "proc" man page says especially oom_adj part. It all started because my important "MQ listeners" ...
66
votes
3answers
6k views
Rsync triggered Linux OOM killer on a single 50 GB file
I have a single 50 GB file on server_A, and I'm copying it to server_B. I run
server_A$ rsync --partial --progress --inplace --append-verify 50GB_file root@server_B:50GB_file
Server_B has 32 GB ...
0
votes
0answers
120 views
OOM Killer when tcpdump is run in system with low memory
I am working on an embedded system with limited memory. Here is the dump from my vmstat:
procs -----------memory---------- ---swap-- -----io---- -system-- ------cpu-----
r b swpd free buff ...
6
votes
3answers
2k views
OOM invoked with plenty of free swap
I am running an ARM router with i2p and tor on it - a Netgear R7000.
Of course I've added a full 512 MB of SWAP to it to prevent OOMs, understanding that it could slow down the system... But then I ...
0
votes
2answers
733 views
Can't Track Down What's Causing Server To Go Out of Memory
For a few months now I've been experiencing random crashes on my 2GB RAM VPS Linode server. Someone convinced me to switch to self-managed hosting and I for some reason thought I could handle it ...
6
votes
4answers
205 views
LInux OOM custom response
I'm running Apache webserver and would like to improve a little bit how the OOM situation is handled.
I'm avare of the OOM scores and already did some customizations in that matter so when something ...
3
votes
2answers
3k views
What's the technique to find out bottleneck?
I setup a wordpress on Digital Ocean for the smallest droplet for a few months.
Recently, my blog gone viral (1000+ facebook shares) and the server take 50+ seconds to respond.(Google Analytics show ...
9
votes
2answers
6k views
Get a core dump of/debugging a process killed by oom-killer
Is there any way to get a core dump of, or be able to debug a process that has been killed by oom-killer?
Or even set oom-killer to try to kill a process using ABRT instead?
1
vote
1answer
1k views
Why did Linux OOM killer activate before using all of the swap?
I have a problem where my Java process gets killed by the kernel OOM killer. I'm not sure why that is happening, because according to syslog I still had free swap space:
Jan 15 08:52:24 xyz-server ...
0
votes
2answers
2k views
when is the jvm heap allocated by the OS
One of our sap systems(PI ABAP+JAVA stack) was giving performance issue. The entire 64GB configured for the machine gets hogged up(and the 8 cores as well). Every one is suspecting the java part,but i ...
1
vote
1answer
786 views
Redis eats up more and more memory
I am running Redis 2.8.17 on Ubuntu 14.04 and yesterday Redis started eating up all the memory until it was killed by OOM. I restarted it multiple times, restarted the server, flushed all the data, ...
1
vote
1answer
418 views
OOM even though page cache high, swap not used, etc
Can you help me diagnose this OOM?
My remarks are in-between.
<4>[598175.284914] cifsd invoked oom-killer: gfp_mask=0x200da, order=0, oom_adj=0, oom_score_adj=0
Whut? GFP mask lower byte 0xa ...
0
votes
2answers
506 views
Out of memory at 72% usage
I've a problem currently with my 48gb ram server: it ramdomly kills processes because of Out of Memory, even if it only uses 72% of it (I got this figure from my monitoring interface). (swap usage: 60%...
10
votes
1answer
12k views
How is kernel oom score calculated?
Looked on The Google, and couldn't find anything that explained how the score in proc/<pid>/oom_score is calculated. Why use this score instead of just using the total memory used?
15
votes
4answers
10k views
Linux oom situation
I have continous oom&panic situation unresolved. I am not sure system fills up all the ram (36GB). Why this system triggered this oom situation? I suspect it as related to lowmem zone in 32 bit ...
3
votes
0answers
679 views
Why can't I malloc as much memory as `free` reports as being free?
The following C program allocates slices of 10MB of memory until it is killed by the Out of Memory killer.
#include <stdio.h>
#include <stdlib.h>
#include <string.h>
#include <...
1
vote
1answer
96 views
On SmartOS how to tell if process was killed for OOM
A daemon process of mine gets killed almost immediately, as soon as it starts receiving requests. The application log has absolutely no error output, even when I try to run it in foreground.
I have ...
1
vote
1answer
229 views
Apache Django OOM on server with 4GB RAM
I'm running a production Django site on Ubuntu Linode w/ 4GB RAM. Major processes are Apache2, MongoDB, Memcache, PostgreSQL, Tomcat6 and Redis. Apache OOMs about 10 times a day. I've tweaked values ...
1
vote
2answers
252 views
How do I make OOM Killer more passive
I am able to compile a program with 1 GiB RAM on a VPS using old 2.6.x kernel. But when I tried to compile it on a VPS with 1.1 GiB RAM and 3.9.x kernel, the compiler always killed by OOM Killer.
How ...
10
votes
3answers
4k views
Why are applications in a memory-limited LXC container writing large files to disk being killed by the OOM?
EDIT2: This problem appears to exist as well under 3.8.0-25-generic #37-Ubuntu SMP
EDIT: I modified the question from the original title of "Why would the Linux Out of Memory manager be triggered by ...
12
votes
2answers
6k views
OOM despite available memory (cache)
We've been running into the OOM killer despite nearly half of our memory being used for the FS cache. We've been logging memory stats once per minute (as reported by top), but there seems to be ...
11
votes
4answers
9k views
How to use kdump/crash to investigate an OOM issue?
The problem
A server crashed after multiple "Out of memory" messages and I am trying to pinpoint the culprit. If it is in userland - which process. If it is in the kernel - which kernel module.
...
