Skip to main content
Share Your Experience: Take the 2024 Developer Survey

Questions tagged [amazon-cloudwatch]

Amazon CloudWatch is a monitoring and management service for Amazon-hosted (AWS) cloud applications.

Filter by
Sorted by
Tagged with
0 votes
1 answer
62 views

How can I monitor Glue jobs that are fired by EventBridge?

My stack is as follows: EventBridge fires a Glue job at a regular interval. Said Glue job runs Python scripts, which run as Step Functions. The output of these scripts is saved to S3. How can I ...
J. Mini's user avatar
  • 51
1 vote
0 answers
289 views

Fluent Bit doesn't create log stream in CloudWatch

Fluent Bit sends only the first logstream and the others not. This is my configuration: config: inputs: | [INPUT] Name tail Path ...
monsterkekso's user avatar
1 vote
1 answer
668 views

Proof that aws cloudwatch get-metric-statistics works

I am learning to use the aws cloudwatch get-metric-statistics subcommand in the AWS command line tool. To prove to myself that I am using the tool correctly, I would like a simple example command that ...
John Skiles Skinner's user avatar
0 votes
0 answers
115 views

alarm for direct connect is showing insufficient data with terraform, how to fix that?

I tried creating alarm for direct connect using this link. But it is showing insufficient data, so I tried creating manually from aws console and it is working. So, did a side by side comparison and ...
user2331760's user avatar
0 votes
2 answers
2k views

How to create cloudwatch alarm for multiple ec2 instances?

Did found the similar question earlier but no solution there. How to create cloudwatch alarm for multiple ec2 instances? Let's say I have 15 ec2 instances, I can group them with a tag, how to create ...
user2331760's user avatar
1 vote
0 answers
120 views

aws guardduty some alerts won't notify on slack

I have recently setup aws guardduty with slack notification using this guide right https://medium.com/@damitj07/how-to-create-a-slack-alert-for-guardduty-49d542927529, there were a few issues with the ...
logax's user avatar
  • 139
1 vote
1 answer
1k views

AWS RDS Slow Query, General, and Audit logs have disappeared. Enhanced Monitoring cannot be turned on

I had AWS RDS enhanced monitoring turned on in our Production and UAT RDS databases. These are connected to an ERP instance. I went to look for slow queries while debugging a user issue, and the Audit,...
J. Gwinner's user avatar
0 votes
0 answers
217 views

How to locate a specific request in AWS, cloudtrail or Athena

How locate a specific request in AWS, cloudtrail or cloudwatch? Request on 2022-11-17T17:07:52.037Z General: Request URL: https://0712f1246-1104-y-https-www-abc-com.mplbci.ekb.eg/access HTTP Version: ...
sam23's user avatar
  • 59
0 votes
1 answer
2k views

AWS-EC2 100% CPU Utilization

I am curious to know about 2 things below about the AWS-EC2 CPU utilization and CPU Credits. What will happen if my AWS-EC2 instance CPU utilization is constantly 100% and I ran out of CPU credits? ...
Surya H's user avatar
  • 21
0 votes
1 answer
107 views

Is it possible to have a Cloudwatch alarm of the specific events of a ElastiCache Redis cluster?

I need some solution to get cloudwatch alarm notification for specific elasticache events like '''ElastiCache:CacheNodeReplaceStarted''', '''ElastiCache:RemoveCacheNodeComplete'''. I know we can ...
Rajaneesh's user avatar
2 votes
0 answers
203 views

AWS CloudWatch Alarm on Max Average CPU from ASG

I am trying to create an alarm in CloudWatch which triggers when any node in a given ASG has greater than 90% average CPU utilisation. I don't want to just do MAX, because we often see short spikes to ...
unclemeat's user avatar
  • 121
1 vote
0 answers
364 views

Why are docker container logs sent from ec2 to cloudwatch in batches using awslogs driver?

I have three docker containers running; server, proxy server and a daemon checking for changes between two databases. I've used docker-compose and an ec2 instance for testing. I would like to stream ...
Oliver Burdekin's user avatar
2 votes
1 answer
438 views

Inconsistency between CloudWatch alert and Container Insights

I am running a .NET 6 container in ECS Fargate. My task definition defines the task size: Task Memory: 1024 Task CPU: 512 The task has 2 containers running - the service and the envoy proxy. The ...
Anthony's user avatar
  • 113
0 votes
1 answer
228 views

AWS Elastic Beanstalk random spike in NetworkIn traffic once to twice a day

Unusual traffic on my Elastic Beanstalk application. NetworkIn, NetworkOut both spike once to twice a day at random times. Sometimes it crashes my load balancer and I have to go in and manually kill ...
Taylor Brown's user avatar
2 votes
1 answer
516 views

How do I get more information about a CloudTrailAuthorizationFailures alarm

I am getting several of these alarms, so I decided to look at the event history in CloudTrail. However there are no events that I can see with error codes. I would've thought that events that cause ...
Ash's user avatar
  • 129
0 votes
2 answers
2k views

Can't find Amplify access logs in CloudWatch log groups

I'm creating a CloudWatch dashboard and I want to monitor Amplify access logs beside other metrics. I can find the access logs inside the Amplify dashboard (Screenshot below) but I can't find the same ...
Fariman Kashani's user avatar
1 vote
0 answers
193 views

Creating a custom CloudWatch Event to monitor every new commit for GitHub repository instead of CodeCommit repo state change

Could you please assist me in understanding if it is possible to create a custom CloudWatch Event to monitor every new commit for GitHub repositories instead of CodeCommit repo state changes? It has ...
Lbits's user avatar
  • 11
1 vote
0 answers
446 views

Zabbix integration with AWS and or Azure

I am trying to figure out direct integration between Zabbix and AWS CloudWatch or Azure Monitor. I have seen YT videos available to integrate Zabbix with grafana first and then integrate grafana with ...
serverstackqns's user avatar
5 votes
2 answers
17k views

Amazon AWS RDS Burst Balance vs CPU Credit Balance

I'm trying to understand if I have spec'd my database appropriately. Below is a chart showing the WriteIOPS, CPUCreditBalance and BurstBalance for a t3.xlarge instance of SQL Server. It looks like I'm ...
Sean's user avatar
  • 153
6 votes
1 answer
1k views

Are the units incorrect for Storage Read / Write graphs in AWS ECS Container Insights?

In AWS Console > CloudWatch > Container Insights > Performance monitoring > ECS Tasks, the graphs for both Storage Read and Storage Write have units shown as Bytes/Second like this: ...
sparrowt's user avatar
  • 307
0 votes
1 answer
2k views

AWS CloudWatch parse JSON case insensitive

On the WAF section of the AWS console there is a tab for "CloudWatch Log Insights" that provides a few sample queries. One of these is "Top 100 hosts". fields @timestamp, @message |...
ficuscr's user avatar
  • 115
2 votes
2 answers
3k views

Difference between display and fields directives in CloudWatch Logs Insights query syntax

What is the difference between display and fields directives in CloudWatch Logs Insights query syntax? These are descriptions from the AWS documentation that look very similar to me : display: ...
illagrenan's user avatar
1 vote
1 answer
892 views

amazon-cloudwatch-agent shuts down on every application reload

I have a Tomcat app on Elastic Beanstalk, and I want to send logs to Cloudwatch Logs. To that end, I set up log4j to write to file, and in .ebextension, amazon-cloudwatch-agent is installed and run. ...
f.khantsis's user avatar
1 vote
1 answer
141 views

Distinguish virtual host in AWS CloudWatch Log Group entries

I am wondering how I can know what host an event in httpd's access/error logs corresponds with once that data is brought into CloudWatch. I use virtual hosts on apache. I currently have a file per ...
ficuscr's user avatar
  • 115
1 vote
0 answers
366 views

Using CloudWatch to monitor concurrent users

I'm looking for a good way to monitor concurrent users in my server. The server's got a websocket connection, so it's easy to determine whether a user is connected or not. After looking into ...
Waneck's user avatar
  • 145
9 votes
1 answer
12k views

AWS: What is the difference between Burst Balance and EBS IO Balance metrics?

AWS Docs describe Burst Balance and EEBS IO Balance in the following way: BurstBalance The percent of General Purpose SSD (gp2) burst-bucket I/O credits available. EBSIOBalance% The percentage of I/O ...
Zillo's user avatar
  • 101
0 votes
1 answer
88 views

How to collect and consolidate application health across instances in aws

We deploy several applications across EC2 instances. They are jar files, war files on Tomcat, npm based UI applications and python scripts. Each has a different way of validation. For war files under ...
Rohini's user avatar
  • 55
2 votes
1 answer
5k views

How can I search across CloudWatch log groups on AWS?

I have a number of lambda functions which run my serverless backend. Something somewhere is misbehaving, and I need to bring up/search all the logs from a particular time — from all log groups, not ...
Mike Ashelby's user avatar
5 votes
1 answer
3k views

Cloudwatch Agent high CPU usage

We are using AWS Cloudwatch to monitor CPU usage, p99 latency for API calls etc. The problem is during peak traffic Amazon Cloudwatch Agent itself is having 25%-35% of CPU usage, thus largely ...
Ramki's user avatar
  • 51
1 vote
0 answers
886 views

Amazon CloudWatch Agent Logging Error and Output

I am having an issue with CloudWatch Agent on a specific EC2 instance. I have tested on several other instance with no issue. I have attached the defined CloudWatch Agent IAM Role specified here to ...
user665458's user avatar
-1 votes
1 answer
778 views

How to diagnose cross account EC2/RDS connection with vpc flow logs in AWS?

In AWS, made 2 accounts. account 1: A | Deployed EC2 account 2: B | Deployed RDS Want to connect from account 1's EC2 to account 2's RDS, but doesn't work. So enabled VPC flow logs to diagnose where ...
Miantian's user avatar
  • 137
2 votes
2 answers
1k views

Permissions for choosing tags in Cloudwatch

When trying to create a Cloudwatch dashboard I get "You don't have permission to access tags and properties. Retry". What permissions does my IAM account have to have in order to be able to ...
jshbrntt's user avatar
  • 121
1 vote
0 answers
336 views

Can I monitor a rolling window using Cloudwatch?

What I'm looking to do within Cloudwatch dashboards is to monitor the performance of my application over 14 days, but re-evaluate that performance every hour. However, from everything I've tried so ...
Slushysnowman's user avatar
1 vote
0 answers
271 views

Auditd to CloudwatchLogs to IDS alerts?

I'm administering a relatively simple AWS stack with about 5 heterogeneous Linux EC2 instances. All instances already have been setup to ship important logs to Cloudwatch Logs. Now I want to setup a ...
spinkus's user avatar
  • 207
6 votes
1 answer
452 views

How to stop Lambda from incurring CloudTrail charges related to CreateLogStream?

I manage an actually not very big website, but Lambda is used extensively, invoked many times per site visit, resulting in hundreds of thousands of calls per month. I noticed a spike in CloudTrail ...
Alex R's user avatar
  • 1,083
3 votes
1 answer
1k views

CloudWatch Agent procstat - get status about all nodejs processes separately

I'm trying to get process level monitoring going for an EC2 instance with a bunch of small nodejs services on it. Right now I am using this configuration: { "metrics": { "...
Christopher Reid's user avatar
3 votes
2 answers
9k views

How do you get a metric of cloudwatch log group size?

I want to track and alert if my logs go awry. But I can't find a way of tracking the stored bytes for a log group. Is it possible to even add that as a metric?
Archimedes Trajano's user avatar
1 vote
1 answer
3k views

CloudWatch InSights: how to extract/query json object array

We have logs published to CloudWatch like this(flattened JSON data using json.dumps()): [ {"Value": 9, "id": "ia-122"}, {"Value": 13, "id": "...
Howard Liu's user avatar
0 votes
1 answer
577 views

How to stream CloudWatch log group to specific Lambda function version?

When creating a new subscription filter for a CloudWatch log group, the AWS Console doesn't seem to offer a way to select a specific Lambda fn version. This is important for CI/CD where I might want ...
AlexanderF's user avatar
1 vote
1 answer
4k views

Seeing Java Spring Boot logs from AWS Elastic Beanstalk in AWS CloudWatch

I'm reading the documentation but I'm not understanding simple Java application log access via CloudWatch from AWS Elastic Beanstalk. I have a simple Java Spring Boot Application deployed on Elastic ...
Garret Wilson's user avatar
2 votes
1 answer
973 views

Setting up autoscaling based on network throughput

I need help in setting up autoscaling based on network throughput. Our front instances are placed inside an autoscaling group. We want the number of instances to increase as a function of network ...
Marcus Stein's user avatar
6 votes
1 answer
28k views

CloudWatch InSights: how to extract/query all JSON array elements at once as a list

My company has started using JSON logging in order to better support CloudWatch InSights queries on AWS. The queries are quite easy to work with, except when we are dealing with array data. For ...
Michael Oryl's user avatar
2 votes
1 answer
1k views

Push log files to AWS Cloudwatch

I have a log file (example: apilog.txt) inside my docker container running in an EC2 instance. I need to push the content in that file to AWS Cloudwatch log groups. How can I achieve this task . ...
Bala krishna's user avatar
2 votes
4 answers
5k views

How to post logs to Cloudwatch with CLI?

Im tring to create a bash script that checks the status of the website, Im using this command: This one to create the logstream aws logs create-log-stream --log-group-name "WebsiteStatusMessage" --...
sysalam0's user avatar
1 vote
0 answers
146 views

Mysterious, intermittent Read I/O on Ubuntu 18.04 based EC2 server - iotop shows no disk reads

I have an EC2 server based on Ubuntu 18.04. With CloudWatch detailed monitoring enabled I'm seeing spikes of Disk Read Operations that last less than 1 minute (shown as 1-minute spikes on the graph) ...
janoside's user avatar
  • 111
3 votes
1 answer
843 views

How to monitor the disk space usage of an AWS elasticache redis cluster?

This is the reason behind this question: I am using a redis cluster on AWS Elasticcache as a datastore. I do not enable eviction because I need to keep the data alive inside the redis cluster for as ...
Anthony Kong's user avatar
  • 3,498
3 votes
1 answer
1k views

AWS Cloudwatch Pricing, what exactly is a metric and how many data points can you have

Disclaimer: I intended to ask this on the AWS Developer forum, but since I just created a forum account, I "might not be able to post messages for a few hours" and I'll surely be asleep by then and ...
dangelsaurus's user avatar
0 votes
1 answer
455 views

CloudWatch / Autoscaling - Remove Capacity Metric Alarm always shows in Alarm, how can I make it not

using the example from https://docs.aws.amazon.com/autoscaling/ec2/userguide/as-scaling-simple-step.html I created an alarm to trigger pruning any unused auto-scaled instances. I'm a big fan of not ...
Chris Whittle's user avatar
1 vote
1 answer
125 views

AWS CloudWatch metric for EC2 security updates

Is it possible to create an AWS CloudWatch metric which keeps track of the pending security updates on an EC2 (Ubuntu) instance? The idea is to have a quicker overview of EC2 instances who are in need ...
SolveSoul's user avatar
  • 113
2 votes
2 answers
1k views

How can I get AWS cloudwatch logs into GCP stack driver logs viewer?

I have set up the "connector account" thing in Stackdriver, and I'm able to see metrics in GCP, which is super cool! I would now like to also get all cloudwatch logs into google's logging tool. Can ...
Askdesigners's user avatar