Questions tagged [amazon-cloudwatch]

Amazon CloudWatch is a monitoring and management service for Amazon-hosted (AWS) cloud applications.

Filter by
Sorted by
Tagged with
3
votes
0answers
35 views

Cloudwatch Agent high CPU usage

We are using AWS Cloudwatch to monitor CPU usage, p99 latency for API calls etc. The problem is during peak traffic Amazon Cloudwatch Agent itself is having 25%-35% of CPU usage, thus largely ...
0
votes
0answers
17 views

Amazon CloudWatch Agent Logging Error and Output

I am having an issue with CloudWatch Agent on a specific EC2 instance. I have tested on several other instance with no issue. I have attached the defined CloudWatch Agent IAM Role specified here to ...
-1
votes
1answer
55 views

How to diagnose cross account EC2/RDS connection with vpc flow logs in AWS?

In AWS, made 2 accounts. account 1: A | Deployed EC2 account 2: B | Deployed RDS Want to connect from account 1's EC2 to account 2's RDS, but doesn't work. So enabled VPC flow logs to diagnose where ...
-1
votes
0answers
13 views

How to diagnose cross account RDS connection with vpc flow logs on AWS? [duplicate]

In AWS, made 2 accounts. account 1: A | Deployed EC2 account 2: B | Deployed RDS Want to connect from account 1's EC2 to account 2's RDS, but doesn't work. So enabled VPC flow logs to diagnose where ...
1
vote
2answers
49 views

Permissions for choosing tags in Cloudwatch

When trying to create a Cloudwatch dashboard I get "You don't have permission to access tags and properties. Retry". What permissions does my IAM account have to have in order to be able to ...
0
votes
0answers
18 views

AWS Problems with CloudWatch Agent - WriteToCloudWatch Failure

I am having issues with a fresh cloudwatch agent installation on one of my EC2 instances. I'm getting the following error: E! WriteToCloudWatch failure, err: RequestError: send request failed caused ...
0
votes
0answers
47 views

AWS CloudWatch Alarm: sliding window period

I'm trying to configure an AWS CloudWatch Alarm on a ApplicationELB TargetGroup that should alarm me whenever there is a "high" number of HTTP 5xx responses by the target (MetricName ...
1
vote
0answers
13 views

Can I monitor a rolling window using Cloudwatch?

What I'm looking to do within Cloudwatch dashboards is to monitor the performance of my application over 14 days, but re-evaluate that performance every hour. However, from everything I've tried so ...
1
vote
0answers
78 views

Auditd to CloudwatchLogs to IDS alerts?

I'm administering a relatively simple AWS stack with about 5 heterogeneous Linux EC2 instances. All instances already have been setup to ship important logs to Cloudwatch Logs. Now I want to setup a ...
0
votes
0answers
9 views

How do you set up a custom “log table” for CloudWatch so that you can see the output of tabular data?

I'd like to create a widget on the AWS dashboard which contains the output of docker service ls and ideally a way of drilling down so I can see the docker service ps of a specific service. I see there'...
1
vote
0answers
11 views

How to stop Lambda from incurring CloudTrail charges related to CreateLogStream?

I manage an actually not very big website, but Lambda is used extensively, invoked many times per site visit, resulting in hundreds of thousands of calls per month. I noticed a spike in CloudTrail ...
1
vote
1answer
99 views
+50

CloudWatch Agent procstat - get status about all nodejs processes separately

I'm trying to get process level monitoring going for an EC2 instance with a bunch of small nodejs services on it. Right now I am using this configuration: { "metrics": { "...
0
votes
1answer
371 views

How do you get a metric of cloudwatch log group size?

I want to track and alert if my logs go awry. But I can't find a way of tracking the stored bytes for a log group. Is it possible to even add that as a metric?
0
votes
0answers
18 views

Is it possible to set up a log widget in a Cloudwatch dashboard such that it does not flash on refresh?

Is it possible to set up a log widget in a Cloudwatch dashboard such that it does not flash on refresh? I have basically set up a log insights like fields @timestamp, @message | sort @timestamp desc | ...
0
votes
1answer
269 views

CloudWatch InSights: how to extract/query json object array

We have logs published to CloudWatch like this(flattened JSON data using json.dumps()): [ {"Value": 9, "id": "ia-122"}, {"Value": 13, "id": "...
0
votes
1answer
61 views

How to stream CloudWatch log group to specific Lambda function version?

When creating a new subscription filter for a CloudWatch log group, the AWS Console doesn't seem to offer a way to select a specific Lambda fn version. This is important for CI/CD where I might want ...
0
votes
0answers
26 views

Can cadvisor publish data to cloudwatch?

I used to use cadvisor as part of swarmprom stack but I want to off load as much of monitoring work to cloudwatch. Is it possible to set up cadvisor (or have an equivalent) publish metrics to ...
0
votes
0answers
21 views

AWS Trigger SNS even when there is change in security group

I am trying to send email when there is a change in security group using cloud trail and cloud watch event. I am using this cloud trail { "source": [ "aws.ec2" ], "detail-type&...
0
votes
0answers
70 views

Pushing historic log files to CloudWatch

I have a (set of) log files that date back over a few years. I can push newly created log entries to CloudWatch, but it seems like there's a 14 day age limit when pushing events. (I'm using boto3 in a ...
1
vote
1answer
1k views

Seeing Java Spring Boot logs from AWS Elastic Beanstalk in AWS CloudWatch

I'm reading the documentation but I'm not understanding simple Java application log access via CloudWatch from AWS Elastic Beanstalk. I have a simple Java Spring Boot Application deployed on Elastic ...
2
votes
1answer
77 views

Setting up autoscaling based on network throughput

I need help in setting up autoscaling based on network throughput. Our front instances are placed inside an autoscaling group. We want the number of instances to increase as a function of network ...
3
votes
1answer
3k views

CloudWatch InSights: how to extract/query all JSON array elements at once as a list

My company has started using JSON logging in order to better support CloudWatch InSights queries on AWS. The queries are quite easy to work with, except when we are dealing with array data. For ...
1
vote
1answer
85 views

Push log files to AWS Cloudwatch

I have a log file (example: apilog.txt) inside my docker container running in an EC2 instance. I need to push the content in that file to AWS Cloudwatch log groups. How can I achieve this task . ...
1
vote
3answers
630 views

How to post logs to Cloudwatch with CLI?

Im tring to create a bash script that checks the status of the website, Im using this command: This one to create the logstream aws logs create-log-stream --log-group-name "WebsiteStatusMessage" --...
1
vote
0answers
55 views

Mysterious, intermittent Read I/O on Ubuntu 18.04 based EC2 server - iotop shows no disk reads

I have an EC2 server based on Ubuntu 18.04. With CloudWatch detailed monitoring enabled I'm seeing spikes of Disk Read Operations that last less than 1 minute (shown as 1-minute spikes on the graph) ...
1
vote
0answers
82 views

How to monitor the disk space usage of an AWS elasticache redis cluster?

This is the reason behind this question: I am using a redis cluster on AWS elasticcache as a datastore. I do not enable eviction because I need to keep the data alive inside the redis cluster for as ...
1
vote
1answer
369 views

AWS Cloudwatch Pricing, what exactly is a metric and how many data points can you have

Disclaimer: I intended to ask this on the AWS Developer forum, but since I just created a forum account, I "might not be able to post messages for a few hours" and I'll surely be asleep by then and ...
0
votes
1answer
41 views

CloudWatch / Autoscaling - Remove Capacity Metric Alarm always shows in Alarm, how can I make it not

using the example from https://docs.aws.amazon.com/autoscaling/ec2/userguide/as-scaling-simple-step.html I created an alarm to trigger pruning any unused auto-scaled instances. I'm a big fan of not ...
1
vote
1answer
35 views

AWS CloudWatch metric for EC2 security updates

Is it possible to create an AWS CloudWatch metric which keeps track of the pending security updates on an EC2 (Ubuntu) instance? The idea is to have a quicker overview of EC2 instances who are in need ...
2
votes
1answer
169 views

How can I get AWS cloudwatch logs into GCP stack driver logs viewer?

I have set up the "connector account" thing in Stackdriver, and I'm able to see metrics in GCP, which is super cool! I would now like to also get all cloudwatch logs into google's logging tool. Can ...
1
vote
1answer
29 views

How does AWS Lambda pass logs to CloudWatch Logs?

AWS somehow aggregate stdout and stderr of a lambda. I once bumped to a situation where a subthread of a lambda process stopped logging in the middle(using async technology was such a bad idea). I'm ...
1
vote
1answer
484 views

create a CloudWatch Alarm when an ECS service unable to consistently start tasks successfully

If I release a new Docker image with a bug to my ECS Service, then the service will attempt to start new Tasks but will keep the old version around if the new tasks fail to start. In that scenario, it ...
0
votes
1answer
73 views

AWS solution to monitor events from external machines, reported by SNS?

We have a number of robots installed at various locations, and servicing customers. All robots get their instructions from a central cloud database with customer data, and each have an SQS queue which ...
1
vote
1answer
102 views

Aws coudwatch metrics convergence

We are in the process of setting up aws cloudwatch exporter(https://github.com/prometheus/cloudwatch_exporter) to export cloudwatch metrics to our prometheus server. When reading through the ...
-1
votes
1answer
687 views

AWS SNS Failed Notifications logging

I had some sns topics which is used for push notification.I want to enable sns topic logging for failed deliveries. Anyone have idea how can i achieve this ?? Thanks in advance
0
votes
1answer
176 views

Route 53 Health Checks and CloudWatch Event(s)

I have a Route 53 health check configured that is used to move a web site in and out of "maintenance mode" in the event that the checks fail. Works all very lovely and automated. The Route 53 health ...
3
votes
3answers
895 views

Best way to log to two different CloudWatch log streams from an ECS container?

We are running our services on AWS's ECS platform, and we send our logs to AWS CloudWatch. We have two types of logs, any container can produce either type: the usual application logs (access, error,...
1
vote
0answers
106 views

AWS lambda add-permission --source-arn weirdness

I'm following this guide on setting up a lambda function to subcribe to log events. In step 5 you need to "Grant CloudWatch Logs the permission to execute your function" like this: aws lambda add-...
1
vote
1answer
114 views

Can I put custom events in the default event bus in AWS EventBridge?

Can I call PutEvents on the default event bus of AWS EventBridge to push custom events? I am trying at the moment but it doesn't seem to do anything (however I do not get an error). After reading a ...
2
votes
1answer
643 views

AWS CloudWatch alarm not populating data points - Insufficient state always

I am configuring CloudWatch alarm from the custom metric. Custom metric for disk space is configured, and I can see that every 5 minutes I am able to see the data. But when I set the alarm, the data ...
0
votes
1answer
160 views

CloudWatch Alarm doesn't show Auto Scaling Groups

I'm trying to trigger an EC2 auto-scaling based on a CloudWatch alarm. I've created the auto scaling group in EC2 - same region and account - but when I try selecting it from the CloudWatch console, ...
1
vote
2answers
81 views

Create / Destroy EC2 instances for ECS tasks

I have various Fargate tasks. They work fine. I then have a few additional tasks that require more disc space than silly old Fargate will allow. These have to run on EC2 instances that I have assigned ...
0
votes
1answer
820 views

AWS EC2 Windows CloudWatch Agent to push memory and disk space metrics

I am trying to configure custom metrics for windows server in EC2. I need memory utilization and free disk space metrics from perfmon. So, the document says we can use AWS SSM and cloudwatch agent to ...
3
votes
0answers
444 views

How to show instance names in CloudWatch graph labels?

We have a couple of machines in AWS EC2 and are running the Amazon CloudWatch Agent on them to collect metrics. Instead of the default ImageId, InstanceId, InstanceType triplet, the agent is ...
1
vote
1answer
776 views

AWS Cloudwatch log filter on stream name

I'm trying to setup a lambda function to process logs from an AWS instance. To do that I'm configuring a CloudWatch Logs "trigger" as input to my Lambda function. The relevant configuration UI on AWS ...
0
votes
2answers
590 views

How to auto-terminate EC2 instances after 24 hours?

An auto-scaling group launches EC2 instances and it appears that instances that run roughly >24 hours begin to degrade in performance. The longest one was running for 3 days until I manually ...
1
vote
1answer
431 views

SQS Cloudwatch Metrics: difference between zero and no-data point at all?

Sometimes when looking at the AWS SQS Cloudwatch Metrics graphs like NumberOfMessagesSent, the graph plotted will show an actual data point at zero, and other times it won't show anything at all. ...
0
votes
1answer
81 views

Monitoring EKS Kubernetes LoadBalancer service Type

I have created few services in Kubernetes with type: LoadBalancer. Platform: EKS. Is there a way to get number of 4xx or 5xx errors from this LoadBalancer? I have tried the following: Prometheus -...
2
votes
1answer
72 views

How to measure GB-seconds for AWS EC2

We are researching on the possibilities of moving our app from EC2 based implementation to AWS lambda. We are trying to project how much money we will be saving if we do so. The lambda pricing says it ...
0
votes
1answer
247 views

Email notification when login attempt fails on RDS SQL Server DB

I need to get notified when there is an attempt to access our SQL database with the incorrect credentials. Is this something that I can do in AWS or do I need to do it in SQL Server? I can manually ...