Questions tagged [grafana]
Grafana is most commonly used for visualizing time series data for Internet infrastructure and application analytics but many use it in other domains including industrial sensors, home automation, weather, and process control.
138
questions
0
votes
0
answers
9
views
Push kubernetes cluster logs to Grafana Cloud Loki issue
I want to setup promtail in my kubernetes cluster to push logs to Grafana Cloud Loki data source. In the grafana cloud guide says to add the following to the promtail/config.yaml
curl -fsS https://raw....
1
vote
0
answers
13
views
Grafana - Have a View Panel button on email notification
I'm switching from Grafana 8 with legacy alerting to Grafana 10.3 with the new unified alerting system. I'd like the email notifications to have buttons to access the dashboard and panel linked to the ...
0
votes
0
answers
24
views
Fluentbit + Firelens unable to parse and ship log JSON fields as labels (AWS ECS Fargate)
My stack is on AWS Fargate. Application, grafana, loki on the same ECS cluster. My application generates logs,
Log Stream sample below:
{"host":"ip-00-3001-1a08-test.us-west-1.compute....
0
votes
0
answers
12
views
Trouble Configuring Zabbix Exporter with Prometheus for Grafana Dashboards
I'm currently attempting to set up Zabbix Exporter to fetch Zabbix metrics into Prometheus for visualization in Grafana dashboards. My goal is to utilize Grafana's features for creating insightful ...
0
votes
0
answers
20
views
Free/total and when free= 10% of total color turns red
I am using Grafana and I am trying to display the values of "Free space/Total size" as actual values rather than calculations. I would like to create a value mapping so that when the free ...
1
vote
0
answers
30
views
Prometheus CPU consumption after remote_write is enabled
I have problems figuring out why my Prometheus instance starts to chew a lot of CPU after I enable remote_write feature.
I have deployed a prometheus and grafana from chart kube-prometheus-stack, ...
0
votes
1
answer
58
views
Cannot add Kubernetes metadata as label to Loki container logs in FluentBit
I am trying to gather container logs in Kubernetes environment using FluentBit, Loki and Grafana.
I would like to append Kubernetes Pod name as label so when I query the logs in Grafana, it would be ...
1
vote
1
answer
73
views
Grafana Agent in Docker runs perfectly for over a week and then suddenly stops working. When we check, the Data folder is gone
We have deployed the Grafana Agent using the official Docker image to send metrics of our server and containers to Grafana Cloud:
docker run \
-v /etc/grafana-wal:/etc/agent/data \
-v /etc/grafana-...
2
votes
2
answers
210
views
Prometheus/grafana : extract hostname from "node_uname_info" metric and create CPU, Memory usage grafana panels
I have populated prometheus.yml -> scrape_configs -> static_configs -> targets section using multiple IP addresses. There is no DNS functionality on prometheus server nor populating hostnames ...
0
votes
1
answer
128
views
How to monitor multiple Kubernetes clusters using single Grafana?
I would like to use a single Grafana instance to monitor multiple Kubernetes cluster (pods resources consumption, rabbitmq queues info) provided by Prometheus. I have two Kubernetes cluster - one used ...
0
votes
0
answers
32
views
Running OTEL agent as windows service is not working
Want to run Otel collecor agent as Windows services. So downloaded latest windows release package and run the following command to create service and start the service.
sc.exe create otelcol ...
0
votes
0
answers
30
views
How to stop an automatic reload of the Grafana Panel
When I go into the panel to modify the Grafana Panel or see the settings, all the panels on the Dashboard automatically reload. Is there a way to stop this?
In other words, I would like to stop ...
0
votes
1
answer
117
views
How to use Grafana Alertmanager for Prometheus rules?
The company decided to centralize all alerting on Grafana (Unified Alerting). Alerts are created through the Grafana UI and the internal Grafana Alertmanager is used for routing alerts to the contact ...
0
votes
0
answers
76
views
Monitor RabbitMQ with Prometheus outside kubernetes cluster
I'm trying to monitor a RabbitMQ set up in a kubernetes cluster by the bitnami helm chart with 3 pods from an Prometheus outside the cluster and I don't understand how that should be possible.
On the ...
0
votes
1
answer
658
views
Setup with promtail + loki + grafana is not showing any log data
In a setup with promtail, loki and grafana, no data shows up in grafana explore. All three parts are running on the same machine.
Question is: where to look for an error in the setup?
Promtail
...
0
votes
0
answers
185
views
Connect multiple hosts running promtail to loki running on a separate host
Hi all first time posting here.
I have 3 different servers. This is the setup I want to achieve:
Server1 (51.25.365.12): promtail
Server2 (51.25.78.215): promtail
Server3 (216.25.36.54): promtail, ...
0
votes
1
answer
112
views
Grafana not sharing dashboards in High Availability mode
I am trying to set Grafana (version 9.5.5, SUSE Linux) to high availability mode using MariaDB on an external server. My understanding is that this should result in my multiple Grafana instances ...
0
votes
0
answers
316
views
Auto-Instrumentation of application using OpenTelemetry
I have an AKS cluster where I am running a test Python-Django based web application.
I also have Grafana and Prometheus configured. I need to use OpenTelemetry to get the metrics data from the test ...
0
votes
0
answers
235
views
OpenTelemetry Collector Data not being fetched by Prometheus in Grafana
I have a requirement where I have some container workload in Azure AKS cluster and I need to use OpenTelemetry to gather data like metrics, logs and traces. I also have Grafana as the visualisation ...
0
votes
0
answers
139
views
OpenTelemetry K8s Operator Collector - Exporter Configuration for Prometheus
I have some container workloads in Azure AKS cluster. I need to use OpenTelemetry to get the metrics, logs and trace data from the container workload and get it collected by the OTEL collector.
I have ...
0
votes
2
answers
835
views
How can i monitor Openstack with prometheus and grafana
I installed openstack with devstack on Ubuntu 20 and installed prometheus and grafana with node exporter and it showed on grafana no issues, but how to monitor openstack components Nova.... There is a ...
0
votes
0
answers
54
views
Write_Prometheus plugin with basic auth
I am testing the below Write_Prometheus plugin to send the cassandra metrics to prometheus server which is external machine but i see that all metrics are sending without any basic auth happening. so ...
0
votes
0
answers
180
views
Prometheus Server Pod Suddenly Crashed (unexpected fault address 0x7f911b1795d4)
With traffic Prometheus server pod getting restarting with below error stack. This is happend when the live traffic of the system. But could not be able to reproduced with the load testing.
Grafana ...
0
votes
0
answers
62
views
Why is my timestamp inconsistent?
Why is the timestamp in my graph inconsistent? I want a consistent time difference of 10s between each data point, but as you can see in the first 'Time' column, the time difference is random 10s, 20s,...
0
votes
0
answers
24
views
How to convert a tabular data to a graph in Grafana?
How can I show the tabular data as a graph on Grafana when it's not doing so automatically? What's the problem here? You can see my query as well as data in the screenshot below:
0
votes
0
answers
27
views
How can I do a difference between values at t0 and t1 in a received data set in Grafana?
I am trying capture the interface bandwidth on a firewall using SNMPv3 and show it on Grafana, I want to do a difference in values at t0 and t1 in the table below in Grafana, for eg., for a difference ...
1
vote
0
answers
369
views
How can I get WAN interface bandwidth accurately via SNMP on Fortinet firewall?
I am getting a sawtooth style of graph on Grafana when I am tying to monitor the ISP WAN interface of my Fortinet firewall. Can someone please guide me on getting the right graph for the WAN interface ...
0
votes
0
answers
308
views
Not able to get Labels from Promtail static_configs
I'm using the latest promtail and loki and trying to use your static_configs example.. but I'm not getting the labels pushed to Loki.. all I see below
Discovered labels
__address
__path
job
I do ...
0
votes
0
answers
154
views
HTTP 502/404 with Grafana in Kubernetes, using AGIC
I'm trying to deploy Grafana in Azure Kubernetes service (AKS), through Helm. I'm using the Helm charts provided by Bitnami. I've been following this Microsoft tutorial to set up the application ...
0
votes
1
answer
294
views
Grafana stuck on loading screen
I've installed Grafana behind Nginx running as a reverse proxy for it and then behind Cloudflare. Unfortunately when I am trying to access it is stuck on jumping Grafana logo with "loading" ...
0
votes
0
answers
101
views
Nginx 403 forbidden on static files using link_secure with grafana
I am trying to configure auto login using nginx as auth proxy, I am successfully able to authenticate but my problem comes when grafana loads all static files are 401.
my nginx configuration
#i also ...
0
votes
1
answer
450
views
Grafana daemon doesn't run
I tried to install grafana-agent by this command that I get grafana.net dashboard:
ARCH="amd64" GCLOUD_HOSTED_METRICS_URL="https://prometheus-prod-24-prod-eu-west-2.grafana.net/api/prom/...
0
votes
0
answers
31
views
How to add attributes about AWS resources to a Grafana panel
The Amazon CloudWatch datasource allows the specification of filters like ec2_instance_attributes that allow the retrieval of information about EC2 instances. I couldn't find the same for EBS volumes ...
1
vote
1
answer
70
views
Display metric for multiple servers on a single grafana panel, using a Snowflake datasource populated from Kafka
I have a collection of servers which submit metrics to a single kafka topic. This data is stored as a row in a snowflake database in this format:
{
"disk_util": 47.7,
"location"...
1
vote
2
answers
92
views
Monitor Azure Kubernetes Service (AKS) with Prometheus servers running independently
Can I deploy Prometheus to each Azure Kubernetes Service (AKS), and monitor each Prometheus from a Prometheus created by a virtual machine outside the AKS? In other words, I want to connect the ...
2
votes
1
answer
2k
views
How can I apply labels to a promtail static_config?
I am collecting logs using rsyslog from about 5000 servers. My collector is writing all logs to a single file on an NFS volume using RFC5424 format. I am mounting this NFS volume on my promtail ...
0
votes
1
answer
1k
views
Monitoring of MySQL replication and alerting when replication is not working
I have a question about monitoring of MySQL replication and in particular about alerting using Grafana/Prometheus.
We have 2 MySQL(MariaDB to be exact) instances for which replication is configured: ...
1
vote
1
answer
574
views
Grafana graph value as a percentage of the initial value
I am new to grafana & prometheus. I want to graph the change in a value (here disk space used), but as a percentage of the initial value, which one commonly sees for inflation charts.
For example, ...
0
votes
1
answer
8k
views
Grafana "Data source connected, but no labels received. Verify that Loki and Promtail is configured properly."
I'm trying to install loki so that I can read logs on Grafana, but I keep receiving Data source connected, but no labels received. Verify that Loki and Promtail is configured properly. (nothing from ...
0
votes
1
answer
2k
views
kube-api server high cpu
I want to know how I can check why one of my ctrl node and kubernetes consumes more cpu than the others.
I have a cluster with 3 ctrl nodes and 4 worker nodes.
I have an nginx load balancer with the ...
0
votes
0
answers
1k
views
Grafana Loki, AlertManager - unable to read rule dir, open /tmp/loki/rules/fake: no such file or directory
I've deployed promtail, Grafana, Loki and AlertManager using Helm charts on k3d cluster on my local machine. I would like to have some rules in Loki such that if something will happen, AlertManager ...
0
votes
0
answers
926
views
Promtail - syslog configuration only logs localhost for hostname and IP
I have a number of boxes that run docker containers. To keep a record of all the logs, we have 1 instance of logspout on every box that grabs all container logs on that box, and routes it to a syslog-...
2
votes
1
answer
3k
views
How to setup alert in helm chart values file?
I am trying to setup grafana alerts in helm chart.
For that, using the existing manually created alert from another grafana instance, which we want to keep in new grafana setup by default with helm ...
1
vote
2
answers
4k
views
Grafana pod is not running, how to fix that?
I have deployed grafana in eks using the steps provided in this link
After deployment of grafana, the pod is not in running state.
kubectl get po -n grafana
NAME READY STATUS ...
1
vote
0
answers
570
views
Default Grafana K8s app PV issue: FailedBinding persistentvolume-controller no persistent volumes available for this claim and no storage class is set
I am simply trying to deploy this Grafana app as-is, no changes to the YAML have been made: https://grafana.com/docs/grafana/latest/setup-grafana/installation/kubernetes/
VMs are Ubuntu 20.04 LTS. The ...
1
vote
0
answers
3k
views
Hostname instead of IPs for panel legends in Grafana with Prometheus metrics
I want to monitor different servers with Prometheus fed by exporters like node-exporter or postgres-exporter. The metrices should be presented in Grafana as dashboards and alerts.
The exporters will ...
2
votes
1
answer
3k
views
Choose all labels in a Grafana time series chart in one go instead of "Ctrl+click"-picking each label until the full list is marked?
In a time-series chart in Grafana, I try to mark a bunch of labels so that all of their curves are shown.
As a default, I get only four labels' curves in the graph, but I have dozens of labels and I ...
1
vote
0
answers
432
views
Zabbix integration with AWS and or Azure
I am trying to figure out direct integration between Zabbix and AWS CloudWatch or Azure Monitor. I have seen YT videos available to integrate Zabbix with grafana first and then integrate grafana with ...
0
votes
0
answers
123
views
enough memory for downscale ubuntu server?
Management decided to downscale prod server.
Current size: Standard B16ms (16 vcpus, 64 GiB memory)
Desired size: Standard B8ms (8 vcpus, 32 GiB memory)
CPU is mostly idle (output is from sar -u)...
0
votes
0
answers
419
views
How to redirect nginx based on sub path?
I have grafana and jenkins running on same azure vm.
For jenkins: http://localhost:8080
For grafana: http://localhost:3000
I thought to set nginx in such a way.
customdomain.com/grafana should go to ...