Take the 2-minute tour ×
Server Fault is a question and answer site for professional system and network administrators. It's 100% free, no registration required.

was hoping someone can shed some light on this reoccurring problem.

We have a medium tier instance running on AWS. But it will go down a random times, normally once a week. I've spent many hours looking through access/error logs of apache trying to spot why, but it's proving to be a nightmare to diagnose. From EC2 console, the instance has a green tick icon, revealing it's running, but I can't ssh on and have to stop then start the instance for it to come back online.

From the apache error logs around the time it went down earlier

127.0.0.1 - - [22/Jan/2012:06:25:03 +0000] "OPTIONS * HTTP/1.0" 200 152 "-" "Apache/2.2.20 (Ubuntu) (internal dummy connection)"
127.0.0.1 - - [22/Jan/2012:06:25:03 +0000] "OPTIONS * HTTP/1.0" 200 152 "-" "Apache/2.2.20 (Ubuntu) (internal dummy connection)"
127.0.0.1 - - [22/Jan/2012:06:25:03 +0000] "OPTIONS * HTTP/1.0" 200 152 "-" "Apache/2.2.20 (Ubuntu) (internal dummy connection)"
127.0.0.1 - - [22/Jan/2012:06:25:03 +0000] "OPTIONS * HTTP/1.0" 200 152 "-" "Apache/2.2.20 (Ubuntu) (internal dummy connection)"
127.0.0.1 - - [22/Jan/2012:07:19:46 +0000] "OPTIONS * HTTP/1.0" 200 152 "-" "Apache/2.2.20 (Ubuntu) (internal dummy connection)"
127.0.0.1 - - [22/Jan/2012:07:19:47 +0000] "OPTIONS * HTTP/1.0" 200 152 "-" "Apache/2.2.20 (Ubuntu) (internal dummy connection)"

From the access logs:

[Sun Jan 22 06:25:03 2012] [notice] Apache/2.2.20 (Ubuntu) PHP/5.3.6-13ubuntu3.2 with Suhosin-Patch configured -- resuming normal operations
[Sun Jan 22 10:01:50 2012] [notice] Apache/2.2.20 (Ubuntu) PHP/5.3.6-13ubuntu3.2 with Suhosin-Patch configured -- resuming normal operations
[Sun Jan 22 10:11:26 2012] [notice] caught SIGTERM, shutting down

Can someone advise what my next steps in diagnosing this problem might be.

Thanks

share|improve this question
add comment

1 Answer

Don't treat this as purely an Apache problem. The symptoms you've given don't warrant that. (e.g., those logs contain nothing unusual-- just that Apache didn't shut down cleanly at the time of the incident, which you already knew, since you bounced the machine) I'm not saying you can entirely rule Apache out, but I wouldn't check it first if a machine is pingable but not SSH-able. (Green in EC2 means pingable, right? If not, then you definitely should ping it!)

Check system logs (eg the message log, sometimes found at at /var/log/messages, and other stuff in /var/log and other log locations, including logs for any other applications you run on that system, including stuff like sshd) logs for other applications in addition to Apache.

Also, when you couldn't SSH in, was that with a connection refused or with ssh hanging? Just curious. If/when this issue happens again, check whether any other services are accessible, if you have any open besides httpd and sshd (and it's pingable!).

Hope you track down the issue! :-)

share|improve this answer
add comment

Your Answer

 
discard

By posting your answer, you agree to the privacy policy and terms of service.

Not the answer you're looking for? Browse other questions tagged or ask your own question.