1
vote
2answers
162 views

logging/capturing STDERR/STDOUT on Amazon EC2

I'm looking for a solution that would allow me to automatically capture the STDOUT/STDERR of a process running on Amazon EC2, and send it (remotely) to another server. Sound simple, except: I will ...
2
votes
1answer
84 views

Enable HAProxy logging in Amazon Gentoo

I am attempting to enable HAProxy logging in Gentoo 1.12.11.1 on an Amazon EC2 Server (managed through EngineYard). I have modified the syslog.conf file as follows: local0.* ...
1
vote
2answers
503 views

disk space keeps filling up on EC2 instance with no apperent files/directories

How come os shows 6.5G used but I see only 3.6G in files/directories? Running as root on an Amazon Linux AMI (seems like Centos), lots of free memory available, no swapping going on, no apparent file ...
0
votes
1answer
48 views

Log every request to an Amazon Linux instance

We run a simple server using a Linux EC2 instance, which includes a Java applet with a .JAR and associated assets .ZIP file. We're seeing some issues on the client side which suggest the applet is ...
2
votes
1answer
438 views

Remote rsyslog only writing logging data to /var/log/syslog and not custom logfiles

I'm having a problem setting up rsyslog to log remote logging data to a specific file. I have two Windows Server 2008 boxes that each have a C# application using NLog.Targets.Syslog which log their ...
3
votes
2answers
326 views

Monitoring AWS Systems Behind ElasticBeanStalk

So I'm getting a company set up in the Amazon Cloud -- creating IAAS protocol/solutions/standardized implementation, etc while also being the SysAdmin for individual systems, app environments, and ...
-2
votes
1answer
734 views

file transfer between s3 and ec2

I want to automate transfer of tomcat log files from micro instance to S3 account. However, all the scripts I find online use key pair in order to do this. I cant upload these key pair to the server ...
5
votes
1answer
513 views

rsyslog update on Amazon Linux suddenly treats INFO level messages as EMERG

I'm having strange issue with rsyslog on some of my EC2 instances running Amazon Linux 2012.3. Upon yum upgrading rsyslog 4.6 to 5.8.10, it seems like every INFO level log message is suddenly treated ...
1
vote
2answers
2k views

Remote logging - Nginx over Rsyslog or any other alternative

I need to setup centralized remote access logging of Auto Scaling Instances. Currently I have Rsyslog / Apache2 logging working just fine, but for the new project Nginx is used and I don't see any ...
1
vote
1answer
203 views

Node app crashes after a while on micro EC2 instance even with supervisor

I'm using supervisor to start my node.js application on a micro EC2 instance. However, the app only stays running for some time until it eventually shuts down. Not exactly sure how long the app stays ...
5
votes
1answer
1k views

simple and reliable centralized logging inside Amazon VPC

I need to set up centralized logging for a set of servers (10-20) in an Amazon VPC. The logging should be as to not lose any log messages in case any single server goes offline - or in the case that ...
3
votes
1answer
264 views

Disk writes every 15 minutes?

Just trying to get to the bottom of this. I run a Web app on a LAMP stack on Amazon EC2. Typically the server is writing about 2.5MB/min to the hard drives. It looks like the apache log file and ...
0
votes
2answers
89 views

Apache stops writing logs after moving/deleting them

I have a bunch of ec2 instances running web services; every hour I want to copy the logs back to S3. Which works perfectly well. But, it appears if I move the logs and then touch a new file, or just ...
0
votes
1answer
1k views

How do i view / enable kernel logs on an ec2 instance (amazon linux)?

I've got a amazon ec2 server that i'm playing around with TCP settings in the sysctl.conf to increase the number of concurrent TCP connections it can handle, and i want to be able to view the kernel ...
0
votes
1answer
277 views

Using ubuntu cloud-init to setup logging to splunk

I intend to start up ~100 EC2 spot instances using Canonical's Ubuntu images. I am using multipart cloud-init user-data to setup packages, scripts, etc. I would like to know how I can tell rsyslog to ...
1
vote
0answers
118 views

Does the Facebook Scribe Server support authenticating its clients and securing the client/server connection?

I plan on running a Facebook Scribe Server on an AWS EC2 providing logging services to several Heroku hosted Rails clients. Is there a mechanism to authenticate Scribe clients in cloud-based ...
5
votes
2answers
1k views

How to log all the MySQL queries that waited for a table lock?

We are trying to diagnose a deadlock problem MySQL 5.0. Currently all the tables are MyISAM tables and so all the locks are table locks. We have a good table_locks_waited to table_locks_immediate ...
1
vote
1answer
290 views

How to download AWS logs/stats

The graphs are nice but how can I download stats to analyze AWS performance? Is there an API call that I can make?
2
votes
1answer
349 views

Managing logs for several dynamic instance on Amazon

I have this problem or rather an itch that I could really use help with. I use autoscale and several instances on Amazon. Problem is I have all these logs PHP, Apache, system but also my web app ...
2
votes
1answer
196 views

How can I get around a length limit on EC2 system logs retrieved through the console?

I am running ami-ccf405a5, which is a Ubuntu 10.10 Maverick EBS boot from alestic.com in a micro instance in us-east from the AWS Console. I use the user-data field to load in a script, the beginning ...
0
votes
1answer
110 views

How can I check the emails that EC2 has blocked me from sending?

I just got a notification that I'm not allowed to send any more emails from my EC2 instance. Which is a bit perplexing since I wasn't aware that I was sending any. Is there some way for me to have a ...
1
vote
1answer
367 views

Logging and Log-viewing tool for cloud?

I have an app which simply logs to a file. I am planning to deploy this app on cloud. If I deploy it on AmazonEC2 instances (multiple), I would want to monitor logs of every instance. Something which ...
2
votes
2answers
1k views

How to send email notification, when ubuntu ec2 server shuts down?

I'm running ec2 instance with ubuntu server and sometimes it seems to be shut down. Is it possible to send an email notification, if server switches to runlevel 0? And how?
1
vote
2answers
172 views

Apache2 logging to file that contains server ip address

We are working towards load balancing our amazon ec2 web servers running apache2. Until we get a better log system in place, we would like to have each instance simply write their server logs to a ...