Questions tagged [google-stackdriver]
The google-stackdriver tag has no usage guidance.
83
questions
0
votes
1
answer
103
views
Pagerduty is not closing a stack driver incident if it is manually resolved
The following scenario causes an orphaned SD incident:
Stack driver incident triggered off metric
PD is notified
The PD incident is manually resolved AND the metric stops sending data (somewhat of an ...
2
votes
1
answer
1k
views
How I can send all logs from journald to GCP Logging?
Don't know what to add more to question, just want to send all logs. My applications write logs to journald, there is no files on disk.
UPD.
Just to clarify, there are files where journald store logs, ...
0
votes
1
answer
322
views
How to differentiate docker containers in stackdriver logging?
I have a VM in GCE with docker installed. There I run containers using the Google Cloud Logging driver. I can see the logs in stackdrive logging. However, i can't easily browse between logs of ...
1
vote
1
answer
796
views
Google Cloud Monitoring storage dashboard not showing Object Count or Object size for bucket
I'm trying to see Object Count and Object Size in the Cloud Monitoring dashboard for Cloud Storage. For some buckets, the Object Count and Object size data are not populating. All I'm seeing is "...
0
votes
2
answers
986
views
Create alerts of for two projects in gcp monitoring workspace
Hi I have two projects project-A and project-B. I have created a monitoring workspace in project-A and added project-B in that workspace. I want to create alerts from log based metrics . I have ...
0
votes
1
answer
342
views
Send google compute startup script output to stackdriver
For ease of management I'd like the output of my GCE startup script to be sent to stackdriver so that admins don't need to SSH into the instance to see the output.
I found this guide for setting up ...
1
vote
2
answers
5k
views
HIgh CPU Usage on Google Cloud Monitoring
I am running a Google Cloud VM. Once I go to the monitoring Tab. I see that VM CPU utilisation is 70% as shown in screenshot also.
Google Cloud MOnitoring
But Once I SSH and use the terminal and use ...
1
vote
1
answer
550
views
Reset GCP compute engine instance on stackdriver alert
I have stackdriver alerts setup that notify whenever the CPU utilisation for a compute engine instance falls below or rises above some thresholds.
I would like to restart the instance whenever this ...
1
vote
1
answer
2k
views
How to disable Stackdriver Monitoring in Google Cloud Kubernetes?
I found this answer: https://serverfault.com/questions/918671/how-to-disable-stackdriver-monitoring-for-a-project?r=SearchResults&s=1|89.7109
But it's from 2 years ago and can't be applied at the ...
0
votes
1
answer
150
views
google cloud Stackdriver Metrics to scale an Manage instance group - Regional
What are the Stackdriver Metrics we can use to autoscale Regional Manage instance groups ?
When i check the docs it says
Regional managed instance groups do not support filtering for per-instance ...
2
votes
1
answer
2k
views
GCE stackdriver logging agent (fluentd) memory leak with COS
I have a VM on GCE where I run a custom Docker image. I installed it on COS (cos-stable-74-11895-125-0) to a g1-small (1 vCPU, 1.7 GB memory) instance.
It is an Elasticsearch with locked memory ...
1
vote
1
answer
2k
views
How to implement Cloud Monitoring Uptime checks for instances without external IP ( private websites )
Cloud Monitoring Uptime checks allow users to send a request to a resource to see if it respond.
Since the checks are performed outside Google Cloud infrastructure, an external ip is needed.
Is ...
2
votes
2
answers
1k
views
How can I get AWS cloudwatch logs into GCP stack driver logs viewer?
I have set up the "connector account" thing in Stackdriver, and I'm able to see metrics in GCP, which is super cool! I would now like to also get all cloudwatch logs into google's logging tool. Can ...
2
votes
1
answer
774
views
stackdriver severity in GKE sending all to stderr
Tell me whether it is possible to make a separation by severity in stackdriver. All messages in the container are displayed in stderror and in stackdriver, they are marked as errors. The task is to ...
1
vote
1
answer
41
views
Accidently created stackdrive workspace account
I am complete beginner, was trying my hand on google cloud free tier.
Accidentally created stackdriver workspace with default google cloud project.
Will there be charges for it? Does agent by ...
3
votes
1
answer
1k
views
How do I exclude health checks from Google Cloud Stackdriver traces
I'm running my app in Google Kubernetes Engine, and the Stackdriver Traces are very useful to determine the health and speed of my app.
However the large majority of request coming into my app are ...
0
votes
1
answer
555
views
GCP Stackdriver log event for failed API attempts due to insufficient access scopes
I would like to monitor for Compute Engine service accounts that attempt API calls beyond their given Access Scope. This could be via the gcloud command or manual API interaction using the OAuth token ...
0
votes
2
answers
3k
views
How can I be sure that a VM on GCP was not shut down due to it being preemptible? (after the fact, using stackdriver)
I'm looking for a query for stackdriver which will yield preemption events on GCP VMs.
Why? Because I have pods disappearing from nodes. Apparently those nodes are later on terminated due to missing ...
0
votes
2
answers
133
views
Latency volatility
I use Google Stackdriver Uptime Check on two websites. One of the sites shows a very steady latency graph, whereas the other site's latency graph is constantly spiking up and down.
The site that is ...
0
votes
0
answers
426
views
How to manually install Stackdriver Monitoring on Google Cloud Platform
We are running several microservices on Google Cloud Platform (GKE using master version v1.12.9-gke.15) and have been using the Stackdriver integration for logging and monitoring (https://cloud.google....
0
votes
1
answer
859
views
K8S HPA custom Stackdriver - 503 The service is currently unavailable - avoids scaling
We have an horizontal pod auto-scaler (HPA) installed on gke cluster, most of the time the auto-scaler works perfectly fine. but from time to time (mostly on our customer rush hours) the auto scaler ...
0
votes
1
answer
380
views
Google App Engine Traffic Analytics by UserAgent/Operating system
I have an app running in Google App Engine. Their ecosystem seems to provide some facilities for analytics from logs in StackDriver.
For the life of me I can't figure out how to get a simple chart ...
0
votes
1
answer
178
views
How do i make stackdriver graphs show 24 hour format dates
In my stackdriver dashboard, the horizontal axis is always date/time but it displays in am/pm format, e.g. 5pm, which is a pain as everything else in my workflow is 24hour.
I cannot for the life of ...
1
vote
3
answers
5k
views
How to monitor HTTPS and TCP Load Balancers on GCP
we are using HTTPS and TCP Load balancers in the Google Cloud Platform (GCP) and we want to monitor them (e.g. with Stackdriver).
For us, one main criteria seems to be the amount of healthy backend ...
1
vote
1
answer
705
views
Set Stackdriver severity based on textPayload
We have an in-house Java application created by our developers that uses log4j to format its logging messages. Recently, we've started to run this on Google Kubernetes Engine and so logs are piped ...
1
vote
0
answers
92
views
Googke K8s - Stackdriver Kubernetes Engine Monitoring is enabled but cant see logs in Logs Viewer
Google K8S - Master version 1.13.6-gke.6
On my K8S cluster is Stackdriver Kubernetes Engine Monitoring Enabled, Legacy Stackdriver Logging Disabled, Legacy Stackdriver Monitoring Disabled.
...
1
vote
0
answers
26
views
Migrating from one cluster to a new one in google cloud
I have 7-8 different microservices running on google cloud.
I'm planning to do API monitoring and I've been asked to use google's stackdriver trace for it.
However it turns out, you cannot use ...
3
votes
1
answer
2k
views
How to extract raw plain text logs from Stackdriver?
We need to extract the logs of GKE-hosted reverse proxies in a raw format that can be parsed by SEO log analysis tools. Unfortunately these tools flat out refuse to ingest CSV and JSON files, they ...
1
vote
1
answer
928
views
GAE stackdriver debugger "The debugger could not find a debug target for the application" error
I have deployed a flex aspcore app on GAE and now want to debug it. Unfortunately the stackdriver debugger page is not letting me go further with the following error
"The debugger could not find a ...
1
vote
0
answers
238
views
Google cloud VPC Firewall rule does not show any rejected logs
I have Google VPC firewall rule to allow ssh(default tcp:22) access to a specific IP address (for example 1.2.3.4/32), this firewall rule has the highest priority in the VPC.
The firewall rule has ...
0
votes
1
answer
94
views
How to suppress recovery notification in Stackdriver?
I have Alerting Policy in Google's Stackdriver which sends a notification when there is an error in the specific log.
For the obvious reason, there is no recovery for such condition, i.e. I don't want ...
0
votes
1
answer
1k
views
Stackdriver logs stopped appearing in GCP Stackdriver Logging Console
Background
I have a Flask server running on GCE's container-optimized image. This server prints a log for every request. Normally, I can view the logs my application prints in GCP Stackdriver Logging ...
2
votes
1
answer
2k
views
Kubernetes Nginx Ingress Controllers log to Stackdriver
I'm using Nginx Ingress Controller on GKE and I want to send its logs to Stackdriver with the following format https://cloud.google.com/logging/docs/reference/v2/rest/v2/LogEntry#HttpRequest. At the ...
4
votes
2
answers
2k
views
Stackdriver monitor for valid HTTPS certificate?
Stackdriver is great for checking uptime, unfortunately it doesn't care if a TLS certificate is expired or invalid. Has Anyone been able to configure it so that it fails and triggers warnings when the ...
0
votes
1
answer
962
views
How to get pod's TCP or WebSocket connection count on Google Kubernetes Engine?
Is there any way to get pod's TCP or WebSocket connection count on Google Kubernetes Engine?
My point is, i need to create and scale new pod instance if my pod's connection count (not request) is over ...
0
votes
1
answer
53
views
Stackdriver cannot get inventory list and apache data other than scoreboard
I'm working on a project where I have several GCE instances serving web content through apache.
I've installed stacdriver monitoring and logging successfully in those instances, but in the Resources -...
0
votes
1
answer
67
views
Google Stackdriver Policy Alert Time Period
I have some uptime checks on instances running only in specific day hours.
I would like to be able to receive fail alert only in this period.
Anyone know if there is a way to set time period like ...
1
vote
2
answers
2k
views
Why no sshd logs on Stackdriver?
On a GCP Compute Engine instance, OS is Ubuntu 18.04, Stackdriver logging agent is installed.
Any idea why Stackdriver doesn't ingest auth.log by default? What would be the best way to do it?
2
votes
1
answer
1k
views
Monitoring reports incorrect CPU usage on GCP
I currently administer a website hosted on Google Cloud Platform using Kubernetes Engine. Yesterday I noticed the CPU% feed on the GKE node drop dramatically to just north of 0. After investigating it ...
0
votes
1
answer
50
views
Specifying resource in Stackdriver logging
I have a problem with custom metric for Google Stackdriver logging. I have created a simple metric for 404 errors, with this filter:
resource.type="gce_instance" textPayload: "HTTP" textPayload: "404"...
0
votes
1
answer
331
views
Creating custom alerting policies using data streamed to the cloud from a sensor
I was looking for information and help on how to use data acquired from a sensor device and uploaded to my google cloud project as a metric for an alerting policy on Stackdriver Monitoring.
Currently ...
0
votes
1
answer
270
views
How to monitor Kafka Consumer lag in Stackdriver?
I can view all the Kafka broker metrics by using the JMX exporter -> stackdriver monitoring agent and is displayed in the Stackdriver but i cant see any consumer metrics, i am particularly interested ...
1
vote
1
answer
633
views
Stackdriver Logging doesn't recognize time field in JSON log
I'm using Google Kubernetes Engine (GKE) in conjunction with Stackdriver Logging.
The Stackdriver's documentation says there are some special fields used by Logging agent to set fields in the ...
0
votes
1
answer
323
views
stackdriver not monitoring kafka metrics
I am trying to setup kafka metrics on stackdriver. I followed all steps as mentioned in https://cloud.google.com/monitoring/agent/plugins/kafka , but still cant see "kafka" metrics. Although I can see ...
0
votes
1
answer
240
views
How to automate stackdriver monitoring? Why stackdriver apis are used for?
How can I create new stack driver chart for any VM or cluster or pods created in Stackdriver automatically? Is there any way to achieve stackdriver charts as soon as any resource mentioned above is ...
8
votes
2
answers
17k
views
Use a wild card in StackDriver Logging
I would like to use wildcard in Google StackDriver Logging filter.
However, according to the official website, filter can not use it.
Is there any method I can use?
2
votes
2
answers
3k
views
Stackdriver missing GKE Logs
I brought up a new Vault cluster using Terraform (https://github.com/sethvargo/vault-on-gke) and everything is working fine with Vault. However I can't seem to see any Container, Node or Pod logs in ...
2
votes
1
answer
737
views
structured logging from a cloud function
So I've been banging my head against this for a while now, thought I'd ask here.
Is it possible to use structured logging from within a Cloud Function?
The log and metrics agents aren't available in ...
4
votes
2
answers
1k
views
How to log backend latency in Google Http Load Balancer and Stack Driver
We have a running kubernetes cluster on GKE and we Google HTTP Load Balancer in front of it.
HTTP Load Balancer logs all requests and we can access them in stack driver logging. But latency is not ...
0
votes
1
answer
746
views
Missing logs in Stackdriver from Kubernetes deployments using GKE
Currently running 28+ deployments under GKE logging to Stackdriver using the automatic fluentd collection.
Master K8s Version: 1.10.6-gke.2
Node Version: 1.10.6-gke.2
Logging approximately 200 JSON ...