Linux Out-of-memory Killer

learn more… | top users | synonyms

0
votes
2answers
41 views

when is the jvm heap allocated by the OS

One of our sap systems(PI ABAP+JAVA stack) was giving performance issue. The entire 64GB configured for the machine gets hogged up(and the 8 cores as well). Every one is suspecting the java part,but i ...
1
vote
1answer
58 views

Redis eats up more and more memory

I am running Redis 2.8.17 on Ubuntu 14.04 and yesterday Redis started eating up all the memory until it was killed by OOM. I restarted it multiple times, restarted the server, flushed all the data, ...
0
votes
0answers
39 views

OOM even though page cache high, swap not used, etc

Can you help me diagnose this OOM? My remarks are in-between. <4>[598175.284914] cifsd invoked oom-killer: gfp_mask=0x200da, order=0, oom_adj=0, oom_score_adj=0 Whut? GFP mask lower byte 0xa ...
0
votes
0answers
10 views

How to adjust oom_adj on linux-vserver?

How to adjust oom_adj for some process on linux-vserver? I've added cap to CAP_SYS_RESOURCE, i've try to use chcontext to xid of vserver, but... i can't adjust oom_adj values of some process. It's ...
0
votes
2answers
81 views

Out of memory at 72% usage

I've a problem currently with my 48gb ram server: it ramdomly kills processes because of Out of Memory, even if it only uses 72% of it (I got this figure from my monitoring interface). (swap usage: ...
0
votes
0answers
74 views

How do I set a negative oom_score_adj as a non-root user?

We use supervisord to start and stop processes and make sure that if a process dies that it comes back up. On each box, we have one "main" process. On one particular box, the main process uses a lot ...
2
votes
1answer
471 views

How is kernel oom score calculated?

Looked on The Google, and couldn't find anything that explained how the score in proc/<pid>/oom_score is calculated. Why use this score instead of just using the total memory used?
7
votes
4answers
2k views

Linux oom situation

I have continous oom&panic situation unresolved. I am not sure system fills up all the ram (36GB). Why this system triggered this oom situation? I suspect it as related to lowmem zone in 32 bit ...
2
votes
0answers
221 views

Why can't I malloc as much memory as `free` reports as being free?

The following C program allocates slices of 10MB of memory until it is killed by the Out of Memory killer. #include <stdio.h> #include <stdlib.h> #include <string.h> #include ...
1
vote
1answer
45 views

On SmartOS how to tell if process was killed for OOM

A daemon process of mine gets killed almost immediately, as soon as it starts receiving requests. The application log has absolutely no error output, even when I try to run it in foreground. I have ...
1
vote
1answer
77 views

Apache Django OOM on server with 4GB RAM

I'm running a production Django site on Ubuntu Linode w/ 4GB RAM. Major processes are Apache2, MongoDB, Memcache, PostgreSQL, Tomcat6 and Redis. Apache OOMs about 10 times a day. I've tweaked values ...
1
vote
2answers
116 views

How do I make OOM Killer more passive

I am able to compile a program with 1 GiB RAM on a VPS using old 2.6.x kernel. But when I tried to compile it on a VPS with 1.1 GiB RAM and 3.9.x kernel, the compiler always killed by OOM Killer. How ...
6
votes
3answers
976 views

Why are applications in a memory-limited LXC container writing large files to disk being killed by the OOM?

EDIT2: This problem appears to exist as well under 3.8.0-25-generic #37-Ubuntu SMP EDIT: I modified the question from the original title of "Why would the Linux Out of Memory manager be triggered by ...
3
votes
1answer
786 views

OOM despite available memory (cache)

We've been running into the OOM killer despite nearly half of our memory being used for the FS cache. We've been logging memory stats once per minute (as reported by top), but there seems to be ...
10
votes
4answers
3k views

How to use kdump/crash to investigate an OOM issue?

The problem A server crashed after multiple "Out of memory" messages and I am trying to pinpoint the culprit. If it is in userland - which process. If it is in the kernel - which kernel module. ...
0
votes
1answer
58 views

nginx / mod_passenger on linode instance with oom messages - where to look next?

I am running an Ubuntu Server that is starting to have problems. It's very lightly used but am confused to why it is now having memory issues. I've included some of the output from syslog and free -m. ...
0
votes
1answer
277 views

Android java build drained 8GB of memory [closed]

I build Android-4.0.4 for odroid-x on a lenovo x220 core i7 8GB of RAM running Linux Mint 12 (Ubuntu-11.10). I start 5 jobs to build, and after a while OOM triggers and kills dozen of processes until ...
4
votes
1answer
383 views

Disable Linux kernel from killing postgresql process

I have standard 'out-of-the-box' installation of Linux version 3.0.1.stk64 (dfn@localhost.localdomain) (gcc version 4.5.1 20100924 (Red Hat 4.5.1-4) (GCC) ) #1 SMP Sat Aug 13 12:53:46 EDT 2011 It ...
0
votes
2answers
951 views

Why malloc() can return NULL if Linux has 20G of 'cached' memory as shown in `top`? [closed]

My application randomly returned OOM errors trying to allocate 16M chunks, while Linux had plenty memory used by disk cache (20G). Swapping disabled. All OS limits seem fine. After clearing Linux ...
3
votes
2answers
503 views

Ubuntu how to detect if OOM killer have run

We use Nagios to monitor our servers. Now.. linux uses all the RAM we give them so there is no way to detect if we are about to run out of memory. We have a couple of times had some server crashes due ...
0
votes
1answer
2k views

An oom killer that I cannot explain

I am not able to understand why would kernel issue this oom killer when I see enough memory is available: I say enough memory is available after looking at Normal DMA Normal free lines This is an ...
2
votes
2answers
1k views

Why is OOM killer hitting here

We have some VMs running kernel 2.26.26-2 under xen 4.0.3 with different CPU and RAM amounts and on some seeing almost random OOM events each rendering the VM unusable. Output is as follows, I have ...
7
votes
2answers
2k views

How do I prevent Linux from freezing when out of memory?

Today I (accidentally) ran some program on my Linux box that quickly used a lot of memory. My system froze, became unresponsive and thus I was unable to kill the offender. How can I prevent this in ...
1
vote
1answer
453 views

How to find which cgroup caused OOM?

I'm using cgroup to partition my processes and I'm getting Out Of Memory messages in my kernel logs. However, I can't find which partition causes them. I've checked the memory controller cgroup but ...
2
votes
3answers
246 views

MySQL - Identifying a never ending, server crashing query

My server keeps crashing from OOM errors cause by MySQL. I am convinced there is a query on this site that is wrong, too long and causes this issue. My server and MySQL logs show very little strain ...
6
votes
3answers
10k views

OOM killer killing things with plenty(?) of free RAM

The OOM killer seems to be killing things despite having more than enough free RAM on my system: (Full resolution) (Full resolution) 27 minutes and 408 processes later, the system started ...
0
votes
1answer
703 views

Linux oom-killer kills Jboss on Ubuntu Server (hosted Amazon EC2)

We having some trouble with oom-killer and JBoss on Ubuntu Server. What I want to know is if there a way to avoid this with extra parameters passed to the JVM or to JBoss? On the other hand, do you ...
0
votes
1answer
774 views

Java / JBoss 5.1.0 triggers OOM Killer

I'm running a CentOS centos-release-6-0.el6.centos.5.x86_64 (2.6.32-71.29.1.el6.x86_64) box with 32GB RAM and 6 vCPUs as a virtual machine. Java is running in version Java(TM) SE Runtime Environment ...
0
votes
3answers
949 views

php-fpm invokes oom-killer

I'm seeing an issue where PHP-FPM works perfectly for a few days, and then decides to fill up all the memory + swap and invoke OOM-Killer. After this happens, the server is completely dead and you ...
2
votes
1answer
1k views

Using linux oom_score_adj to aim the oom daemon at the right target

On Ubuntu 11.04, /proc/[pid] contains oom_score_adj, but man proc describes the old oom_adj. What I need to arrange is that processes started by 'pbs' or 'gridengine' are killed before anything else ...
2
votes
1answer
211 views

Weird console problem in linux, usually right before OOM

So I've noticed this happen more than once. If I remember correctly, this usually happens right before OOM, and/or kernel panic that if you type into a tty and then try to backspace it, the same ...
4
votes
2answers
785 views

OOM killer goes insane

On our cluster we would sometimes have nodes go down when a new process would request too much memory. I was puzzled why the OOM killer does not just kill the guilty process. The reason turned out to ...
1
vote
1answer
262 views

high load and OOM-killer on domUs while pvmove

Situation xen 4.0.1 dom0 (debian squeeze) domUs all with LVs as disks: disk = [ 'phy:/dev/vg-00/domu-swap,xvda1,w', 'phy:/dev/vg-00/domu-disk,xvda2,w' ]) one VG (vg-00) with 2 PVs Goal Move all ...
1
vote
3answers
437 views

monitoring when a process starts using too much memory

I have a Debian server where some processes going rogue from time to time and start consuming too much memory. How I could monitor this at process level so I can set an alarm? Currently I monitor when ...
0
votes
2answers
227 views

LAMP/Postfix on Debian. Rare OOM-ing - tools to track down?

I'm getting seemingly random server hangs (specifically OOM-ing) and running out of skill trying to track this down. I'm using a Debian 5 VS with Apache/mySQL/PHP. I've got Postfix running using ...
0
votes
1answer
403 views

Xen 4.0.1 Dom0 draws too much memory by nothing apparent - ooms out when streched under 900 MB

Greetings, I've setup a new ubuntu 10.10 server for xen 4.0.1, though it included kernel compilation (creating PVOPS 2.6.32 kernel) and all the stuff by their guide - (generally include xen and ...
2
votes
2answers
843 views

lighttpd eating all memory and CPU

So my lighttpd was running fine for more than a year. Two days ago I decided to install Wordpress 3.0.1 (PHP was already in use by other tools). So after some hours of very few hits (i might get 10 ...
4
votes
3answers
8k views

what do these messages suggest (linux kernel dump, seems OOM)?

I got the following errors from system log (/var/log/messages). what they indicate? And how to solve them? Sep 30 05:19:35 node23 kernel: Mem-info: Sep 30 05:19:35 node23 kernel: Node 0 DMA per-cpu: ...
7
votes
1answer
2k views

Forensic Analysis of the OOM-Killer

Ubuntu's Out-Of-Memory Killer wreaked havoc on my server, quietly assassinating my applications, sendmail, apache and others. I've managed to learn what the OOM Killer is, and about its "badness" ...
5
votes
5answers
8k views

How to reliably take Java Heap Dumps?

My team is running into difficulties when trying to take good heap dumps triggered by OutOfMemoryErrors. For specific reasons we are currently taking the dumps with jmap called from a bash script ...
4
votes
5answers
2k views

Prevent Linux's OOM from killing apache on our webserver

We have a debian linux webserver. It's just running apache2. Our mysql server is on another host. However we sometimes run cron tasks on the webserver to do regular tasks. However recently one of the ...
1
vote
2answers
1k views

OOM-Killer, jboss and kernel panic

We are running RedHat 3.4.6(x32) on VMWareEsx3.5(x64) with 6GB RAM. A few java processes(including jboss) are running in the background. The problem is that the java processes consume lots of memory, ...
26
votes
3answers
16k views

Turn off the Linux OOM killer by default?

The OOM killer on Linux wreaks havoc with various applications every so often, and it appears that not much is really done on the kernel development side to improve this. Would it not be better, as a ...