Questions tagged [amazon-cloudwatch]
Amazon CloudWatch is a monitoring and management service for Amazon-hosted (AWS) cloud applications.
187
questions
1
vote
0
answers
256
views
Fluent Bit doesn't create log stream in CloudWatch
Fluent Bit sends only the first logstream and the others not. This is my configuration:
config:
inputs: |
[INPUT]
Name tail
Path ...
0
votes
0
answers
83
views
How to snooze all cloudwatch alarms at specific time?
I am trying to setup snooze option for all alarms in my AWS account. To accomplish this I have tried the below terraform code. I kept my account id as dummy value 12345678.
resource "...
0
votes
0
answers
60
views
Is that possible to monitor mysql in cloudwatch?
I have some server in EC2, In that i have configured memory/disk usage metric in cloudwatch it is showing overall usage but i want to check memory of particular path How to check that? Is that ...
1
vote
1
answer
622
views
Proof that aws cloudwatch get-metric-statistics works
I am learning to use the aws cloudwatch get-metric-statistics subcommand in the AWS command line tool. To prove to myself that I am using the tool correctly, I would like a simple example command that ...
0
votes
0
answers
103
views
alarm for direct connect is showing insufficient data with terraform, how to fix that?
I tried creating alarm for direct connect using this link.
But it is showing insufficient data, so I tried creating manually from aws console and it is working.
So, did a side by side comparison and ...
0
votes
2
answers
2k
views
How to create cloudwatch alarm for multiple ec2 instances?
Did found the similar question earlier but no solution there.
How to create cloudwatch alarm for multiple ec2 instances?
Let's say I have 15 ec2 instances, I can group them with a tag, how to create ...
1
vote
0
answers
106
views
aws guardduty some alerts won't notify on slack
I have recently setup aws guardduty with slack notification using this guide right https://medium.com/@damitj07/how-to-create-a-slack-alert-for-guardduty-49d542927529, there were a few issues with the ...
1
vote
1
answer
1k
views
AWS RDS Slow Query, General, and Audit logs have disappeared. Enhanced Monitoring cannot be turned on
I had AWS RDS enhanced monitoring turned on in our Production and UAT RDS databases. These are connected to an ERP instance.
I went to look for slow queries while debugging a user issue, and the Audit,...
0
votes
0
answers
207
views
How to locate a specific request in AWS, cloudtrail or Athena
How locate a specific request in AWS, cloudtrail or cloudwatch?
Request on 2022-11-17T17:07:52.037Z
General:
Request URL: https://0712f1246-1104-y-https-www-abc-com.mplbci.ekb.eg/access
HTTP Version: ...
0
votes
1
answer
2k
views
AWS-EC2 100% CPU Utilization
I am curious to know about 2 things below about the AWS-EC2 CPU utilization and CPU Credits.
What will happen if my AWS-EC2 instance CPU utilization is constantly 100% and I ran out of CPU credits?
...
0
votes
1
answer
100
views
Is it possible to have a Cloudwatch alarm of the specific events of a ElastiCache Redis cluster?
I need some solution to get cloudwatch alarm notification for specific elasticache events like '''ElastiCache:CacheNodeReplaceStarted''', '''ElastiCache:RemoveCacheNodeComplete'''.
I know we can ...
2
votes
0
answers
178
views
AWS CloudWatch Alarm on Max Average CPU from ASG
I am trying to create an alarm in CloudWatch which triggers when any node in a given ASG has greater than 90% average CPU utilisation.
I don't want to just do MAX, because we often see short spikes to ...
1
vote
0
answers
349
views
Why are docker container logs sent from ec2 to cloudwatch in batches using awslogs driver?
I have three docker containers running; server, proxy server and a daemon checking for changes between two databases. I've used docker-compose and an ec2 instance for testing. I would like to stream ...
2
votes
1
answer
416
views
Inconsistency between CloudWatch alert and Container Insights
I am running a .NET 6 container in ECS Fargate. My task definition defines the task size:
Task Memory: 1024
Task CPU: 512
The task has 2 containers running - the service and the envoy proxy. The ...
0
votes
1
answer
208
views
AWS Elastic Beanstalk random spike in NetworkIn traffic once to twice a day
Unusual traffic on my Elastic Beanstalk application. NetworkIn, NetworkOut both spike once to twice a day at random times. Sometimes it crashes my load balancer and I have to go in and manually kill ...
2
votes
1
answer
491
views
How do I get more information about a CloudTrailAuthorizationFailures alarm
I am getting several of these alarms, so I decided to look at the event history in CloudTrail.
However there are no events that I can see with error codes. I would've thought that events that cause ...
0
votes
2
answers
1k
views
Can't find Amplify access logs in CloudWatch log groups
I'm creating a CloudWatch dashboard and I want to monitor Amplify access logs beside other metrics. I can find the access logs inside the Amplify dashboard (Screenshot below) but I can't find the same ...
1
vote
0
answers
188
views
Creating a custom CloudWatch Event to monitor every new commit for GitHub repository instead of CodeCommit repo state change
Could you please assist me in understanding if it is possible to create a custom CloudWatch Event to monitor every new commit for GitHub repositories instead of CodeCommit repo state changes? It has ...
1
vote
0
answers
435
views
Zabbix integration with AWS and or Azure
I am trying to figure out direct integration between Zabbix and AWS CloudWatch or Azure Monitor. I have seen YT videos available to integrate Zabbix with grafana first and then integrate grafana with ...
5
votes
2
answers
16k
views
Amazon AWS RDS Burst Balance vs CPU Credit Balance
I'm trying to understand if I have spec'd my database appropriately. Below is a chart showing the WriteIOPS, CPUCreditBalance and BurstBalance for a t3.xlarge instance of SQL Server. It looks like I'm ...
6
votes
1
answer
1k
views
Are the units incorrect for Storage Read / Write graphs in AWS ECS Container Insights?
In AWS Console > CloudWatch > Container Insights > Performance monitoring > ECS Tasks, the graphs for both Storage Read and Storage Write have units shown as Bytes/Second like this:
...
0
votes
1
answer
2k
views
AWS CloudWatch parse JSON case insensitive
On the WAF section of the AWS console there is a tab for "CloudWatch Log Insights" that provides a few sample queries. One of these is "Top 100 hosts".
fields @timestamp, @message
|...
2
votes
2
answers
3k
views
Difference between display and fields directives in CloudWatch Logs Insights query syntax
What is the difference between display and fields directives in CloudWatch Logs Insights query syntax?
These are descriptions from the AWS documentation that look very similar to me :
display: ...
1
vote
1
answer
840
views
amazon-cloudwatch-agent shuts down on every application reload
I have a Tomcat app on Elastic Beanstalk, and I want to send logs to Cloudwatch Logs. To that end, I set up log4j to write to file, and in .ebextension, amazon-cloudwatch-agent is installed and run.
...
1
vote
1
answer
137
views
Distinguish virtual host in AWS CloudWatch Log Group entries
I am wondering how I can know what host an event in httpd's access/error logs corresponds with once that data is brought into CloudWatch. I use virtual hosts on apache. I currently have a file per ...
1
vote
0
answers
362
views
Using CloudWatch to monitor concurrent users
I'm looking for a good way to monitor concurrent users in my server. The server's got a websocket connection, so it's easy to determine whether a user is connected or not. After looking into ...
9
votes
1
answer
12k
views
AWS: What is the difference between Burst Balance and EBS IO Balance metrics?
AWS Docs describe Burst Balance and EEBS IO Balance in the following way:
BurstBalance The percent of General Purpose SSD (gp2) burst-bucket I/O
credits available.
EBSIOBalance% The percentage of I/O ...
0
votes
1
answer
85
views
How to collect and consolidate application health across instances in aws
We deploy several applications across EC2 instances. They are jar files, war files on Tomcat, npm based UI applications and python scripts.
Each has a different way of validation.
For war files under ...
2
votes
1
answer
5k
views
How can I search across CloudWatch log groups on AWS?
I have a number of lambda functions which run my serverless backend. Something somewhere is misbehaving, and I need to bring up/search all the logs from a particular time — from all log groups, not ...
5
votes
1
answer
3k
views
Cloudwatch Agent high CPU usage
We are using AWS Cloudwatch to monitor CPU usage, p99 latency for API calls etc. The problem is during peak traffic Amazon Cloudwatch Agent itself is having 25%-35% of CPU usage, thus largely ...
1
vote
0
answers
861
views
Amazon CloudWatch Agent Logging Error and Output
I am having an issue with CloudWatch Agent on a specific EC2 instance. I have tested on several other instance with no issue.
I have attached the defined CloudWatch Agent IAM Role specified here to ...
-1
votes
1
answer
761
views
How to diagnose cross account EC2/RDS connection with vpc flow logs in AWS?
In AWS, made 2 accounts.
account 1: A | Deployed EC2
account 2: B | Deployed RDS
Want to connect from account 1's EC2 to account 2's RDS, but doesn't work. So enabled VPC flow logs to diagnose where ...
2
votes
2
answers
1k
views
Permissions for choosing tags in Cloudwatch
When trying to create a Cloudwatch dashboard I get "You don't have permission to access tags and properties. Retry".
What permissions does my IAM account have to have in order to be able to ...
1
vote
0
answers
325
views
Can I monitor a rolling window using Cloudwatch?
What I'm looking to do within Cloudwatch dashboards is to monitor the performance of my application over 14 days, but re-evaluate that performance every hour. However, from everything I've tried so ...
1
vote
0
answers
260
views
Auditd to CloudwatchLogs to IDS alerts?
I'm administering a relatively simple AWS stack with about 5 heterogeneous Linux EC2 instances. All instances already have been setup to ship important logs to Cloudwatch Logs. Now I want to setup a ...
6
votes
1
answer
439
views
How to stop Lambda from incurring CloudTrail charges related to CreateLogStream?
I manage an actually not very big website, but Lambda is used extensively, invoked many times per site visit, resulting in hundreds of thousands of calls per month.
I noticed a spike in CloudTrail ...
3
votes
1
answer
1k
views
CloudWatch Agent procstat - get status about all nodejs processes separately
I'm trying to get process level monitoring going for an EC2 instance with a bunch of small nodejs services on it.
Right now I am using this configuration:
{
"metrics": {
"...
3
votes
2
answers
9k
views
How do you get a metric of cloudwatch log group size?
I want to track and alert if my logs go awry. But I can't find a way of tracking the stored bytes for a log group. Is it possible to even add that as a metric?
1
vote
1
answer
3k
views
CloudWatch InSights: how to extract/query json object array
We have logs published to CloudWatch like this(flattened JSON data using json.dumps()):
[
{"Value": 9, "id": "ia-122"},
{"Value": 13, "id": "...
0
votes
1
answer
553
views
How to stream CloudWatch log group to specific Lambda function version?
When creating a new subscription filter for a CloudWatch log group, the AWS Console doesn't seem to offer a way to select a specific Lambda fn version. This is important for CI/CD where I might want ...
1
vote
1
answer
4k
views
Seeing Java Spring Boot logs from AWS Elastic Beanstalk in AWS CloudWatch
I'm reading the documentation but I'm not understanding simple Java application log access via CloudWatch from AWS Elastic Beanstalk.
I have a simple Java Spring Boot Application deployed on Elastic ...
2
votes
1
answer
933
views
Setting up autoscaling based on network throughput
I need help in setting up autoscaling based on network throughput.
Our front instances are placed inside an autoscaling group. We want the number of instances to increase as a function of network ...
6
votes
1
answer
27k
views
CloudWatch InSights: how to extract/query all JSON array elements at once as a list
My company has started using JSON logging in order to better support CloudWatch InSights queries on AWS. The queries are quite easy to work with, except when we are dealing with array data.
For ...
2
votes
1
answer
1k
views
Push log files to AWS Cloudwatch
I have a log file (example: apilog.txt) inside my docker container running in an EC2 instance.
I need to push the content in that file to AWS Cloudwatch log groups.
How can I achieve this task .
...
2
votes
4
answers
5k
views
How to post logs to Cloudwatch with CLI?
Im tring to create a bash script that checks the status of the website, Im using this command:
This one to create the logstream
aws logs create-log-stream --log-group-name "WebsiteStatusMessage" --...
1
vote
0
answers
142
views
Mysterious, intermittent Read I/O on Ubuntu 18.04 based EC2 server - iotop shows no disk reads
I have an EC2 server based on Ubuntu 18.04. With CloudWatch detailed monitoring enabled I'm seeing spikes of Disk Read Operations that last less than 1 minute (shown as 1-minute spikes on the graph) ...
3
votes
1
answer
791
views
How to monitor the disk space usage of an AWS elasticache redis cluster?
This is the reason behind this question: I am using a redis cluster on AWS Elasticcache as a datastore. I do not enable eviction because I need to keep the data alive inside the redis cluster for as ...
3
votes
1
answer
1k
views
AWS Cloudwatch Pricing, what exactly is a metric and how many data points can you have
Disclaimer: I intended to ask this on the AWS Developer forum, but since I just created a forum account, I "might not be able to post messages for a few hours" and I'll surely be asleep by then and ...
0
votes
1
answer
431
views
CloudWatch / Autoscaling - Remove Capacity Metric Alarm always shows in Alarm, how can I make it not
using the example from https://docs.aws.amazon.com/autoscaling/ec2/userguide/as-scaling-simple-step.html I created an alarm to trigger pruning any unused auto-scaled instances.
I'm a big fan of not ...
1
vote
1
answer
120
views
AWS CloudWatch metric for EC2 security updates
Is it possible to create an AWS CloudWatch metric which keeps track of the pending security updates on an EC2 (Ubuntu) instance? The idea is to have a quicker overview of EC2 instances who are in need ...