1

Last night at about 4:30am, both our app servers decided to have a seizure. We can't figure out why. Visitor load was low (100 live on the site) and there are no cron jobs scheduled on the servers.

We run ubuntu with apache, passenger and rails 3.0.3. The apache error log had a "cannot allocate memory" error right when the blue line dropped to the floor. Not sure what this tells me though since, the server runs well 99% of the time.

Any ideas for figuring out the root cause?

Thanks.

CPU Graph over the last 12 hours for our app servers

Improve this question

2 Answers 2

Reset to default
0

Some robot indexing your pages? google?

Or an attacking script trying logins or searching for not secured apps or not updated services with known vulnerabilities?

Improve this answer
1
  • Yes, time to hit the logs. The servers were pushed to 60% load for over an hour: there must be footprints left on your system somewhere.
    – DutchUncle
    Feb 18, 2011 at 19:21
0

Notice that you're using EC2. Are both app servers in the same EC2 availability zone? Were there any kernel messages relating to errors (via dmesg)?

Improve this answer

You must log in to answer this question.

Not the answer you're looking for? Browse other questions tagged .