I have a process (JVM) on a Linux (RHEL) machine that is getting killed for no apparent reason. This has happened twice in the past couple of days. The JVM prints the following before it dies:
Service killed by signal 9
Which leads me to believe that something is killing it with SIGKILL (-9).
My initial thought was that this is the OOM killer, however I cannot find any evidence of the OOM killer doing anything in either /var/log/messages or dmesg (this is RHEL so I don't have syslog or kern.log). In addition the machine is using around 140GB for its buffer cache (out of 196GB), indicating that it has plenty of memory it could give to processes if they needed it.
I'm also reasonably sure that nobody is logging-in and killing this process manually.
Can anybody think of anything that would kill the process like this?
Alternatively can anyone think of a way to discover what is killing the process, if it happens again?