Questions tagged [elasticsearch]

Elasticsearch is a flexible and powerful open source, distributed, real-time search and analytics engine.

Filter by
Sorted by
Tagged with
0
votes
0answers
6 views

Cannot create index patterns in kibana after enabling x-pack security in elasticsearch

After I enabled x-pack security and updated kibana.yml appropriately, kibana sees only its own indices .kibana_1,.kibana_2,.kibana_task_manager, all other indices are unavailable in index pattern ...
0
votes
1answer
24 views

How to display the logs of a VM on ELK stack which is running on another VM?

-ELK is running on localhost & successfully getting logs. -Both VM's are on same server. -OS on both VM'S is Ubuntu 18-04 LTS.
0
votes
1answer
33 views

NGINX - Access port via SSL

I have ElasticSearch and NGINX set up on my server. Accessing it via SSL is failing. I can access ElasticSearch fine via: http://ipaddress:9200 http://mydomain.co.uk:9200 The domain was then set up ...
0
votes
0answers
16 views

Storage balancing in elasticsearch cluster

I've a Elasticsearch cluster with 5 nodes. I've this used storage repartition: Node1: 76% Node2: 94% Node3: 88% Node4: 73% Node5: 74% How to do to storage balancing/leveling the used storage ? For ...
0
votes
0answers
35 views

Correct reverse proxy to aws-es-proxy instance?

I installed a VPC with an Elasticsearch cluster with kibana on AWS. As that is VPC, it is not accessible publicly. Thus, to be able to access the kibana interface, I installed the https://github.com/...
0
votes
0answers
19 views

Logging within Kaseya and sending data to ELK

Has anyone ingested Kaseya log data in ELK? I am looking to log what happens on a Kaseya-managed machine so things like remote access via console, procedures that get run, etc. It seems like there isn'...
0
votes
0answers
25 views

GKE elastic search not working with Kibana

I am trying to use my elastic cluster of GKE using my domain for that I am using GKE Elastic And I am using an external load balancer and then I am using ingress to map it with URL. I can access my ...
0
votes
0answers
14 views

elastalert custom alert rule for detecting more than 20 4xx req per min by Unique IP

Currently i installed elastalert for getting alert through kibana. But now i am stuck with it's rule and i have to set a custom rule which sent an alert when more than 20 4xx requests detected per min ...
0
votes
1answer
19 views

How to use filebeat to find password in log

I have an Elasticsearch 7.1 and i have configure filebeat to collect all log. I want to check if i have password in log. So anyone have an idea how can i find all password in log using filebeat. Thank ...
0
votes
0answers
24 views

systems requirement planning [duplicate]

I am running Ubuntu server 20.04 LTS in a VM hosted on a NAS (Synology.) Primary purpose of this system is to ingest data for ELK. This is the master node. Configuration is: Compute: Intel Celeron ...
1
vote
2answers
68 views

Can you help me understand this ElasticSearch permissions error?

I'm attempting to make a request to an Elastic.co hosted ElasticSearch instance. I'm receiving this error: AuthorizationException(403, 'security_exception', 'action [indices:monitor/stats] is ...
0
votes
1answer
82 views

Portainer: Pass vm.max_map_count to SonarQube Docker container

I need to set up a SonarQube container on my Portainer instance. SonarQube uses Elasticsearch, which needs a kernel setting passed from the host. This issue is well documented, as mentioned in this ...
0
votes
0answers
24 views

Elasticsearch upgrade using yum

Hi I am using Elasticsearch 6.6.0 and trying to upgrade to 7.3.0 I made sure that Elasticsearch version are available on my yum list (actually versions 6.6, 6.8, 7.3.0, 7.4.2, 7.5.2 are all available)....
0
votes
0answers
96 views

Site Address of google cloud

I have been deploying elasticsearch with firebase database. When deployed, I had to index my data. For that I had to use postman. In postman, I wanted the url request which I was supposed to get from ...
0
votes
1answer
1k views

Kibana - “missing authentication credentials for REST request”

I have a elasticsearch cluster with xpack basic license, and native user authentication enabled (with ssl of course). I am attempting to set up kibana on a docker container but keep getting an error ...
0
votes
0answers
18 views

MFA for AWS Managed Kibana

I'm struggling to get TOTP MFA working with AWS managed Elasticsearch, for Kibana logins. My ES domain is public, uses fine-grained access control and Cognito. MFA for the user pool is set to '...
0
votes
0answers
99 views

Elasticsearch systemd setup

I am configuring Elasticsearch 2.3.3 (yes, outdated) on CentOS 7.7. We were running it on CentOS 6 with InitV script. I followed this specification to create systemd script and get inspired with the ...
0
votes
0answers
26 views

Get a list of Kibana dashboards

I am trying to get a list of Kibana dashboards. Here is my command: curl -u 'elastic:xxxxx' -XGET --cacert /opt/ssl-certs/client-ca.cer -s https://x.x.x.x:9201/.kibana/_search?type=dashboard&...
0
votes
0answers
32 views

How to migrate node elasticsearch node?

I have an Elasticsearch cluster with 10 data/master nodes and I want to move one node to another instance. Elasticsearch runs in Docker in every node. What is the simplest/better way to do this? ...
0
votes
0answers
52 views

How to filter in kibana on input fields set in filebeat?

I've got filebeat setup sending logs to kibana. I have the apache module enabled which is sending the httpd error and access logs to kibana. I can filter on these by looking at the event.dataset field ...
0
votes
0answers
44 views

Grafana is erroring out when trying to use elasticsearch

I am trying to use Grafana 6.7.3 with ES 7.6.2 and I keep getting "An unexpected error happened TypeError: Cannot read property 'length' of undefined" and it goes on to with a bunch of html gibberish....
0
votes
0answers
147 views

Monitoring tomcat logs (catalina.out) with Elastic stack and viewing in Kibana?

I've setup and installed Kibana and elastic search on my redhat vm. I then followed the fairly simple instructions to install filebeat with the apache module to gather the information on the apache ...
0
votes
0answers
28 views

Bitnami elastic search external IP is not accessible from web browser

I needed bitnami elastic search for my application. So I spinned up an elastic search instance and all the firewall rules are good, I've allowed https and http traffic. But still I'm unable to access ...
0
votes
0answers
47 views

How to declaratively deploy a default template to an Elasticsearch Operator (ECK) cluster on GKE?

I'm deploying two Elasticsearch 6.8.x clusters to Kubernetes on Google Cloud Platform, using Elasticsearch Operator 1.1.0 from Elastic.co. Since I want this to be version controlled and repeatable I'...
0
votes
0answers
13 views

filebeat feed is not received in kibana

I have migrated jira app from serverA to serverB. I have installed same version of filebeat on serverB as it was on serverA, configured the "filebeat.yml" just like it was on serverA, open the port in ...
0
votes
0answers
6 views

can ELK for log access scale in one node install

i have to install an ELK server for a barracuda log access only. Can i choose a simple VM with 4vcpu,10G Ram and 300G SATA. i will install one node instance. With a configuration like this can the ...
0
votes
1answer
131 views

Can't access Kibana remotely - Can curl successfully on machine

I've installed Kibana on rhel and am I'm trying to access remotely on http://server-url:5601. I've installed elasticsearch and am able to access that remotely on http://server-url:9200 I've added ...
0
votes
0answers
9 views

Adding context paths to ELK log analytics?

I'm looking to install the ELK stack on my application server by following the instructions here: I can see you can then access the various ELK services on localhost via certain ports. Is there a way ...
0
votes
1answer
48 views

Grok filter is not working properly

I have Filebeat-7.1 installed in a Debian server, this Filebeat send data from files in this Debian server to server with Logstash 7.6 , here are the files config Filebeat.yml: #=====================...
0
votes
0answers
28 views

Elasticsearch doesn't start up

I simply restarted an Elasticsearch instance, and it doesn't work after startup. In the logs, I can see an exception: [2020-04-09T19:57:43,582][WARN ][o.e.g.Gateway ] [KibjtLy] recovering ...
0
votes
2answers
41 views

Kibana and Logstash: When is a field not a field?

I've enabled the grok filter in our logstash configuration in order to parse logs from HAProxy using the %{HAPROXYHTTP} and %{HAPROXYTCP} patterns. This seems to work great and viewing the details for ...
1
vote
0answers
104 views

Scaling Elasticsearch down to single-node

Is it possible to scale Elasticsearch from multiple nodes down to one node? I have a 3-node cluster that is way overkill for the amount of data being logged. To scale it down, I set "cluster.routing....
0
votes
1answer
274 views

Does Elasticsearch have capability to form ES cluster with only one ES docker service running multiple replicas of it in Docker-Swarm

I wanna run only one elasticsearch service in docker-swarm having multiple replicas of this service. Does Elasticsearch have capability to form ES cluster with only one ES docker service running ...
0
votes
0answers
11 views

Auto_attribute plugin like discovery_ec2 that works on GCE?

The discovery_ec2 has a very nice feature that populates the attributes for a node based on the EC2 metadata: https://www.elastic.co/guide/en/elasticsearch/plugins/current/discovery-ec2-usage.html#...
0
votes
0answers
33 views

Elasticsearch snapshot can not access directory

I am trying to get elasticsearch to make regular snapshots on Red Hat 8. I started by adding path.repo: "/home/user/backup" to the configuration file. As a test. When I restart the service, it ...
1
vote
0answers
54 views

Index rollover latency

I have created an ILM policy as follows, { "policy": { "phases": { "hot": { "min_age": "0ms", "actions": { "rollover": { "max_docs": 30 }, ...
0
votes
1answer
24 views

Do we need a back up of Elastic Search data in a database in case of failure, or is there a solid permanant storage solution with Elastic Search?

We are looking to use Elastic Search in a major software system, which needs financial logs and records kept for many years. We are using Elastic Search, but are a little concerned whether Elastic is ...
1
vote
1answer
61 views

Virtual machine disk I/O latency spikes

Since past few days I have strange I/O spikes in one virtual machine. Its 2.6.32-504.el6.x86_64 #1 SMP Tue Sep 16 01:56:35 EDT 2014 x86_64 x86_64 x86_64 GNU/Linux Red Hat Enterprise Linux Server ...
0
votes
0answers
24 views

Restricting Elasticsearch with Nginx Basic auth

I have an Elasticsearch instance running on a box at port 9200. I am trying to secure it with Nginx which I am new to. I have running Elasticsearch running on port 9200 and here is my nginx config to ...
0
votes
1answer
37 views

Elasticsearch - how to disable client access on data node?

I am fairly new to Elasticsearch and was watching some tutorials that are somewhat outdated. In the tutorial, they said that if one has dedicated data nodes, it is recommended to disable client ...
0
votes
0answers
165 views

Getting log rotation to work with Elasticsearch and Log4j2

We recently discovered that our ES 6.5 servers never purge old log files. Based on various information found on google I came up with this configuration for log4j2, which we applied to the servers ...
0
votes
0answers
43 views

Auto login for kibana visualizations not working, nginx

Hi im trying to use nginx to auto authenticate in kibana shared visualizations and it isnt working. Im on a centos 8, installed nginx, installed httpd-tools ,I create a folder called: sites-available,...
0
votes
1answer
135 views

Integrating nginx logs and elasticsearch app-search

I'm trying to setup a self-managed docker appsearch instance, together with kibana and elasticsearch, queried by a uvicorn python app, proxied by a nginx webserver My current issue is that the ...
0
votes
1answer
135 views

Pi4+ runs Elasticsearch cluster of 1, gives yellow status

I am currently running Elasticsearch 7.3.2 on a Rasbian (Buster) instance on a Raspberry Pi 4+. It looks like it was running in a green status for a few days, processing files, but suddenly, i ...
0
votes
0answers
15 views

ElasticSearch : LDAP authentication on local node and processing on cloud node

Our LDAP server is restricted to requests from the intranet. But we would like to run ElasticSearch with LDAP on cloud. Is it a good strategy to run a local node of ElasticSearch locally within the ...
0
votes
1answer
226 views

AWS ElasticSearch service does not provide Kibana users management

First I'm going to explain my current architecture. I have an EC2 instance running with a Logstash daemon, as input an http configuration and as output my AWS ElasticSearch instance. As I said before,...
0
votes
0answers
453 views

fluentd correct mapping and indexing of @timestamp

The timestamp in Kibana is a long field (containing a unix timestamp) with the following configuration: <source> @type tail path /logs/other_vhosts_access.log pos_file /logs/access.log....
0
votes
0answers
351 views

ELK - Logstash not picking up syslog events

I'm setting up a ELK cluster using Centos 8 and version 7.4 of Elasticsearch, Logstash and Kibana. My issue is with Logstash not picking up the events coming through syslog. Configuring Logstash to ...
0
votes
0answers
362 views

Run OCR in Nextcloud with Docker

I'm using the official Docker image nextcloud:latest to run my Nextcloud instance. I managed to install Elasticsearch (on the host) and created an index. Search works so far. Now I want to OCR PDFs ...
0
votes
0answers
108 views

elastic search behind haproxy

There are 4 elastic search nodes in a cluster and these 4 nodes are setup behind haproxy. Each of the node in the cluster is receiving around 900 to 1000 tcp connections, but one of the node has very ...

1
2 3 4 5
8