Last call to make your voice heard! Our 2022 Developer Survey closes in less than a week. Take survey.

Questions tagged [amazon-cloudwatch]

Amazon CloudWatch is a monitoring and management service for Amazon-hosted (AWS) cloud applications.

Filter by
Sorted by
Tagged with
0 votes
0 answers
13 views

Is there a procedure required when baking the Amazon CloudWatch agent into an AMI?

I've run into a problem getting the CloudWatch agent started on Windows EC2 instances created from AMIs which I have prepared beforehand. The error I get is this: Service 'Amazon CloudWatch Agent (...
user avatar
0 votes
2 answers
19 views

Can't find Amplify access logs in CloudWatch log groups

I'm creating a CloudWatch dashboard and I want to monitor Amplify access logs beside other metrics. I can find the access logs inside the Amplify dashboard (Screenshot below) but I can't find the same ...
user avatar
0 votes
0 answers
8 views

Creating a custom CloudWatch Event to monitor every new commit for GitHub repository instead of CodeCommit repo state change

Could you please assist me in understanding if it is possible to create a custom CloudWatch Event to monitor every new commit for GitHub repositories instead of CodeCommit repo state changes? It has ...
user avatar
  • 1
0 votes
0 answers
15 views

shutdown my EC2 when my celery worker is idle

i have an AWS-SQS to receive message for the execute task on my celery worker which deployed on an EC2. One task takes around 5-6 min to execute. Actually i want to shutdown EC2 when there is no ...
user avatar
0 votes
0 answers
36 views

Zabbix integration with AWS and or Azure

I am trying to figure out direct integration between Zabbix and AWS CloudWatch or Azure Monitor. I have seen YT videos available to integrate Zabbix with grafana first and then integrate grafana with ...
user avatar
0 votes
2 answers
142 views

Amazon AWS RDS Burst Balance vs CPU Credit Balance

I'm trying to understand if I have spec'd my database appropriately. Below is a chart showing the WriteIOPS, CPUCreditBalance and BurstBalance for a t3.xlarge instance of SQL Server. It looks like I'm ...
user avatar
  • 103
0 votes
0 answers
8 views

What cloudwatch metric do I use for checking how much space is left on Elasticache Redis?

I found that some cached items are being lost on production once in a while, the test and production environment settings are practically the same, so I am suspecting it is Redis running out of "...
user avatar
2 votes
1 answer
115 views

Are the units incorrect for Storage Read / Write graphs in AWS ECS Container Insights?

In AWS Console > CloudWatch > Container Insights > Performance monitoring > ECS Tasks, the graphs for both Storage Read and Storage Write have units shown as Bytes/Second like this: ...
user avatar
  • 235
0 votes
1 answer
219 views

AWS CloudWatch parse JSON case insensitive

On the WAF section of the AWS console there is a tab for "CloudWatch Log Insights" that provides a few sample queries. One of these is "Top 100 hosts". fields @timestamp, @message |...
user avatar
  • 105
0 votes
0 answers
141 views

How to get live logs sent from ECS to AWS cloudwatch

I run containers in ECS on python docker image which has ssh installed because sometimes I need to login to the container. Whatever logs are outputted using print in the python script show up in the ...
user avatar
  • 23
0 votes
0 answers
26 views

amazon cloudwatch agent fails to start

An error I am getting is Failed to execute operation: The name org.freedesktop.PolicyKit1 was not provided by any .service files This error suddenly appeared after I rebuilt my environment. I am ...
user avatar
0 votes
1 answer
379 views

Difference between display and fields directives in CloudWatch Logs Insights query syntax

What is the difference between display and fields directives in CloudWatch Logs Insights query syntax? These are descriptions from the AWS documentation that look very similar to me : display: ...
user avatar
0 votes
0 answers
69 views

amazon-cloudwatch-agent shuts down on every application reload

I have a Tomcat app on Elastic Beanstalk, and I want to send logs to Cloudwatch Logs. To that end, I set up log4j to write to file, and in .ebextension, amazon-cloudwatch-agent is installed and run. ...
user avatar
0 votes
1 answer
43 views

Distinguish virtual host in AWS CloudWatch Log Group entries

I am wondering how I can know what host an event in httpd's access/error logs corresponds with once that data is brought into CloudWatch. I use virtual hosts on apache. I currently have a file per ...
user avatar
  • 105
0 votes
0 answers
11 views

What Performance Counter is closest to watching the "In Use" memory stat shown in Task Manager?

I'm trying to collect usage on how much memory is being used on our Windows servers using AWS CloudWatch Agent. In order to do this, I have to specify which performance counters to collect. I cannot ...
user avatar
1 vote
0 answers
46 views

Using CloudWatch to monitor concurrent users

I'm looking for a good way to monitor concurrent users in my server. The server's got a websocket connection, so it's easy to determine whether a user is connected or not. After looking into ...
user avatar
  • 145
4 votes
1 answer
3k views

AWS: What is the difference between Burst Balance and EBS IO Balance metrics?

AWS Docs describe Burst Balance and EEBS IO Balance in the following way: BurstBalance The percent of General Purpose SSD (gp2) burst-bucket I/O credits available. EBSIOBalance% The percentage of I/O ...
user avatar
  • 51
0 votes
1 answer
32 views

How to collect and consolidate application health across instances in aws

We deploy several applications across EC2 instances. They are jar files, war files on Tomcat, npm based UI applications and python scripts. Each has a different way of validation. For war files under ...
user avatar
  • 23
0 votes
0 answers
169 views

How to send EKS on Fargate container logs in the same pod to different log groups by FireLens/Fluent Bit

I'm gonna send EKS on Fargate container logs to AWS CloudWatch Logs. These container logs are in the same pod. And I want to send container logs to different log groups. Now, these container logs are ...
user avatar
  • 101
1 vote
1 answer
1k views

How can I search across CloudWatch log groups on AWS?

I have a number of lambda functions which run my serverless backend. Something somewhere is misbehaving, and I need to bring up/search all the logs from a particular time — from all log groups, not ...
user avatar
0 votes
0 answers
13 views

How to disable partition wise disk metric in cloudwatch agent

I have instances configured with cloudwatch agent which daily pull the config from AWS SSM parameter store. From https://docs.aws.amazon.com/AmazonCloudWatch/latest/monitoring/create-cloudwatch-agent-...
user avatar
  • 13
0 votes
0 answers
131 views

Automating cloudwatch agent installation for multiple arch types

I need to automate cloudwatch agent installation on new and existing instances created in EC2. We have a mix x86_64 and arm64 arch type vms as well different OSes(Ubuntu/Amazon Linux). I found Chef ...
user avatar
  • 13
0 votes
0 answers
43 views

Using cloudwatch agent without secret and key in AWS

Our current instances use this deprecated method of collecting metrics https://docs.aws.amazon.com/AWSEC2/latest/UserGuide/monitoring-scripts-intro.html It's basically a cron job that runs a command ...
user avatar
  • 13
0 votes
0 answers
118 views

How to build event pattern for cloudwatch->Events->Rules?

Does anyone know how to build a proper "event pattern" in AWS Cloudwatch->Events->Rules? I am trying to send events that exist in a particular AWS CloudWatch Log group to SNS topic. ...
user avatar
  • 1
0 votes
0 answers
93 views

AWS: Read object file from S3 bucket to perform health checks with canary in Synthetics

Instead of doing health checks in the canary script I want to read all websites from an file that is located in an S3 bucket. Are there any way to do this? Script in canary: const s3 = new aws.S3({ ...
user avatar
5 votes
1 answer
1k views

Cloudwatch Agent high CPU usage

We are using AWS Cloudwatch to monitor CPU usage, p99 latency for API calls etc. The problem is during peak traffic Amazon Cloudwatch Agent itself is having 25%-35% of CPU usage, thus largely ...
user avatar
  • 51
1 vote
0 answers
497 views

Amazon CloudWatch Agent Logging Error and Output

I am having an issue with CloudWatch Agent on a specific EC2 instance. I have tested on several other instance with no issue. I have attached the defined CloudWatch Agent IAM Role specified here to ...
user avatar
-1 votes
1 answer
364 views

How to diagnose cross account EC2/RDS connection with vpc flow logs in AWS?

In AWS, made 2 accounts. account 1: A | Deployed EC2 account 2: B | Deployed RDS Want to connect from account 1's EC2 to account 2's RDS, but doesn't work. So enabled VPC flow logs to diagnose where ...
user avatar
  • 127
2 votes
2 answers
377 views

Permissions for choosing tags in Cloudwatch

When trying to create a Cloudwatch dashboard I get "You don't have permission to access tags and properties. Retry". What permissions does my IAM account have to have in order to be able to ...
user avatar
1 vote
0 answers
44 views

Can I monitor a rolling window using Cloudwatch?

What I'm looking to do within Cloudwatch dashboards is to monitor the performance of my application over 14 days, but re-evaluate that performance every hour. However, from everything I've tried so ...
user avatar
1 vote
0 answers
164 views

Auditd to CloudwatchLogs to IDS alerts?

I'm administering a relatively simple AWS stack with about 5 heterogeneous Linux EC2 instances. All instances already have been setup to ship important logs to Cloudwatch Logs. Now I want to setup a ...
user avatar
  • 158
5 votes
1 answer
82 views

How to stop Lambda from incurring CloudTrail charges related to CreateLogStream?

I manage an actually not very big website, but Lambda is used extensively, invoked many times per site visit, resulting in hundreds of thousands of calls per month. I noticed a spike in CloudTrail ...
user avatar
  • 972
3 votes
1 answer
463 views

CloudWatch Agent procstat - get status about all nodejs processes separately

I'm trying to get process level monitoring going for an EC2 instance with a bunch of small nodejs services on it. Right now I am using this configuration: { "metrics": { "...
user avatar
0 votes
1 answer
2k views

How do you get a metric of cloudwatch log group size?

I want to track and alert if my logs go awry. But I can't find a way of tracking the stored bytes for a log group. Is it possible to even add that as a metric?
user avatar
0 votes
1 answer
858 views

CloudWatch InSights: how to extract/query json object array

We have logs published to CloudWatch like this(flattened JSON data using json.dumps()): [ {"Value": 9, "id": "ia-122"}, {"Value": 13, "id": "...
user avatar
0 votes
1 answer
242 views

How to stream CloudWatch log group to specific Lambda function version?

When creating a new subscription filter for a CloudWatch log group, the AWS Console doesn't seem to offer a way to select a specific Lambda fn version. This is important for CI/CD where I might want ...
user avatar
1 vote
1 answer
2k views

Seeing Java Spring Boot logs from AWS Elastic Beanstalk in AWS CloudWatch

I'm reading the documentation but I'm not understanding simple Java application log access via CloudWatch from AWS Elastic Beanstalk. I have a simple Java Spring Boot Application deployed on Elastic ...
user avatar
2 votes
1 answer
294 views

Setting up autoscaling based on network throughput

I need help in setting up autoscaling based on network throughput. Our front instances are placed inside an autoscaling group. We want the number of instances to increase as a function of network ...
user avatar
3 votes
1 answer
9k views

CloudWatch InSights: how to extract/query all JSON array elements at once as a list

My company has started using JSON logging in order to better support CloudWatch InSights queries on AWS. The queries are quite easy to work with, except when we are dealing with array data. For ...
user avatar
1 vote
1 answer
355 views

Push log files to AWS Cloudwatch

I have a log file (example: apilog.txt) inside my docker container running in an EC2 instance. I need to push the content in that file to AWS Cloudwatch log groups. How can I achieve this task . ...
user avatar
2 votes
4 answers
2k views

How to post logs to Cloudwatch with CLI?

Im tring to create a bash script that checks the status of the website, Im using this command: This one to create the logstream aws logs create-log-stream --log-group-name "WebsiteStatusMessage" --...
user avatar
1 vote
0 answers
60 views

Mysterious, intermittent Read I/O on Ubuntu 18.04 based EC2 server - iotop shows no disk reads

I have an EC2 server based on Ubuntu 18.04. With CloudWatch detailed monitoring enabled I'm seeing spikes of Disk Read Operations that last less than 1 minute (shown as 1-minute spikes on the graph) ...
user avatar
  • 111
1 vote
0 answers
178 views

How to monitor the disk space usage of an AWS elasticache redis cluster?

This is the reason behind this question: I am using a redis cluster on AWS elasticcache as a datastore. I do not enable eviction because I need to keep the data alive inside the redis cluster for as ...
user avatar
  • 2,876
3 votes
1 answer
643 views

AWS Cloudwatch Pricing, what exactly is a metric and how many data points can you have

Disclaimer: I intended to ask this on the AWS Developer forum, but since I just created a forum account, I "might not be able to post messages for a few hours" and I'll surely be asleep by then and ...
user avatar
  • 69
0 votes
1 answer
108 views

CloudWatch / Autoscaling - Remove Capacity Metric Alarm always shows in Alarm, how can I make it not

using the example from https://docs.aws.amazon.com/autoscaling/ec2/userguide/as-scaling-simple-step.html I created an alarm to trigger pruning any unused auto-scaled instances. I'm a big fan of not ...
user avatar
1 vote
1 answer
54 views

AWS CloudWatch metric for EC2 security updates

Is it possible to create an AWS CloudWatch metric which keeps track of the pending security updates on an EC2 (Ubuntu) instance? The idea is to have a quicker overview of EC2 instances who are in need ...
user avatar
  • 113
2 votes
1 answer
402 views

How can I get AWS cloudwatch logs into GCP stack driver logs viewer?

I have set up the "connector account" thing in Stackdriver, and I'm able to see metrics in GCP, which is super cool! I would now like to also get all cloudwatch logs into google's logging tool. Can ...
user avatar
1 vote
1 answer
37 views

How does AWS Lambda pass logs to CloudWatch Logs?

AWS somehow aggregate stdout and stderr of a lambda. I once bumped to a situation where a subthread of a lambda process stopped logging in the middle(using async technology was such a bad idea). I'm ...
user avatar
2 votes
1 answer
2k views

create a CloudWatch Alarm when an ECS service unable to consistently start tasks successfully

If I release a new Docker image with a bug to my ECS Service, then the service will attempt to start new Tasks but will keep the old version around if the new tasks fail to start. In that scenario, it ...
user avatar
  • 556
0 votes
1 answer
77 views

AWS solution to monitor events from external machines, reported by SNS?

We have a number of robots installed at various locations, and servicing customers. All robots get their instructions from a central cloud database with customer data, and each have an SQS queue which ...
user avatar