Questions tagged [elasticsearch]

Elasticsearch is a flexible and powerful open source, distributed, real-time search and analytics engine.

Filter by
Sorted by
Tagged with
0
votes
0answers
22 views

Issue with starting kubernetes elasticsearch pods due to access denied in elasticsearch.keystore

I already have a EFK stack on a kubernetes cluster in AWS EKS and I intend to add s3 logging functionality for the elasticsearch pods in es-statefulset. For this, I have created a custom elasticseach ...
1
vote
0answers
20 views

Regarding freeradius rlm_rest module configuration to authenticate user from elasticsearch

I'm trying to authenticate user using rest module in freeradius, user data is stored in elasticsearch database. testing using: < radtest -x chandanbr 008627 localhost 0 testing123 > i'm getting ...
0
votes
0answers
50 views

elasticsearch.service is not a native service, redirecting to systemd-sysv-install

after installing Elasticsearch on Debian using these instructions, I am trying to enable it as a service using this command sudo /bin/systemctl enable elasticsearch.service But I get this error: ...
0
votes
1answer
30 views

Running Enterprise Search as a service

Elastic's Enterprise Search Installation Guide goes as far as starting the process locally - which is obviously not very stable. When installed from a .deb or .rpm, a service is actually set up and ...
0
votes
1answer
47 views

Is there a way to use the ingest attachment plugin with Elastic App Search

I'm working on a portal that hosts multiple types of documentation (HTML, PDF, PPTx, DocX) and makes them all searchable in one place. We could achieve this using the "standard" out of the ...
0
votes
0answers
19 views

ElasticSearch stuck 'Processing'

We started an ElasticSearch software update last week via the AWS console but it now seems to be stuck on Processing and the index is unresponsive. In the Cluster Health tab the cluster status is ...
2
votes
1answer
101 views

Kibana does not trust Let's Encrypt CA in Kubernetes Helm Setup

I have a k8s cluster configured with calico as networking system. I'm running slightly customized versions of helm elastic/elasticsearch and elastic/kibana with security enabled. For security, I use ...
0
votes
0answers
29 views

Azure app service ELK monitoring

I'm looking for suggestions on pushing logs for applications hosted on Azure app services (both on windows and linux app service plans) to a hosted logstash instance. I've made some research and there ...
1
vote
1answer
208 views

When to use a new index in Graylog (Elasticsearch)?

I have been searching for days now to find a good explanation on how indices are used by Graylog/Elasticsearch and when to create a new one. There is a lot of info about sharding indices but not much ...
0
votes
0answers
23 views

Assign type 'date' to a field in fluentd record transformer while displaying in Elastic Search

Hi I have a fluentd config setup to filter logs sent to ElasticSearch. I have a field 'TIME' which is created from an existing field but that is shown as 'unknown' type in Elastic Search. I like t ...
0
votes
0answers
10 views

A 4th ElasticSearch node that has ALL the shards for offsite backup

I have a 3-node Elasticsearch 7.9.3 cluster. It consists of 3 master-capable nodes, and 7 indexes are spread as 2 shads on 2 of the nodes. I would like to have a 4th node, not master-capable, that has ...
0
votes
1answer
88 views

Filebeat on ECK with AWS Module Fails Due To Metadata Error

We are running an Elastic Stack with ECK in EKS (7.8). We noticed that our filebeat daemonset and the AWS module were not processing logs from S3 and our SQS queues backing up. Looking at the logs on ...
0
votes
0answers
71 views

Elasticsearch - Can I delete a data-stream backing index?

I have a few data-streams configured in my Elasticsearch cluster (with ILM policy). Suppose I run into storage problems and etc. and I want to prematurely delete a few backing indices of the data-...
0
votes
0answers
34 views

Elasticsearch & Searchkick error when server has less than 5% free space

I have a Ruby on Rails project that's using Elastic Search and Searchkick gem, hosted on Digital Ocean server. Every week or so, the logs or something will take up the space on the server, and when ...
0
votes
0answers
34 views

Elasticsearch - does compression affect shard sizing calculations?

I was reading about elasticsearch shard sizing at: https://www.elastic.co/blog/how-many-shards-should-i-have-in-my-elasticsearch-cluster In the article, they write a few tips in regards of the shard ...
0
votes
0answers
40 views

Filebeat nginx plugin gets errors at setup for kibana values in filebeat.yml

I have having an issue with the config setup for filebeat and trying to setup the plugin for nginx logs. I've been unable to complete setup due to the following. I've tried numerous values and syntax ...
0
votes
1answer
669 views

Kibana cannot be accessed through port 5601 in browser [duplicate]

I cannot get to kibana through web UI. I'm set the necessary ports in firewall-cmd, I've configured kibana.yml and elasticsearch.yml. I'm not seeing any relevant errors, or at least don't know if they ...
0
votes
0answers
24 views

Multiple Web Application - Cache Layer Design

I have multiple client e-commerce web applications running on a single VM, each web application is a node.js express application. The express web application communicates with the back end via API's ...
0
votes
1answer
36 views

How to stop ElasticSearch background task

According to the CLI help of ElasticSearch, you can start ElasticSearch in the background with elasticsearch -d or elasticsearch --daemonize. This is what I use all the time locally, as it seems to ...
0
votes
0answers
23 views

Ubuntu server 'partially' responsive

I have an Ubuntu 18.04 server that has periodically unresponsive - I can ping it, and it appears that some https services are running (albeit v. slowly), however it hangs if I try to log in (on the ...
0
votes
1answer
40 views

realtime monitoring of linux server network

We have a few Linux server which act as Edge network, We want realtime (or near-realtime) information on network bandwidth, top IP addresses and network bandwidth per them and other network parameters ...
0
votes
0answers
24 views

ElasticSearch Allow Elastic Beanstalk

I'm trying to give permission for a elastic search to do the connection altought elastic beanstalk. Unfortunately the elastic search domain isn't in vpc and actualy each IP that beanstalk change, need ...
0
votes
0answers
155 views

Cannot create index patterns in kibana after enabling x-pack security in elasticsearch

After I enabled x-pack security and updated kibana.yml appropriately, kibana sees only its own indices .kibana_1,.kibana_2,.kibana_task_manager, all other indices are unavailable in index pattern ...
0
votes
1answer
42 views

How to display the logs of a VM on ELK stack which is running on another VM?

-ELK is running on localhost & successfully getting logs. -Both VM's are on same server. -OS on both VM'S is Ubuntu 18-04 LTS.
0
votes
1answer
42 views

NGINX - Access port via SSL

I have ElasticSearch and NGINX set up on my server. Accessing it via SSL is failing. I can access ElasticSearch fine via: http://ipaddress:9200 http://mydomain.co.uk:9200 The domain was then set up ...
0
votes
0answers
17 views

Storage balancing in elasticsearch cluster

I've a Elasticsearch cluster with 5 nodes. I've this used storage repartition: Node1: 76% Node2: 94% Node3: 88% Node4: 73% Node5: 74% How to do to storage balancing/leveling the used storage ? For ...
1
vote
0answers
184 views

Correct reverse proxy to aws-es-proxy instance?

I installed a VPC with an Elasticsearch cluster with kibana on AWS. As that is VPC, it is not accessible publicly. Thus, to be able to access the kibana interface, I installed the https://github.com/...
0
votes
1answer
37 views

How to use filebeat to find password in log

I have an Elasticsearch 7.1 and i have configure filebeat to collect all log. I want to check if i have password in log. So anyone have an idea how can i find all password in log using filebeat. Thank ...
1
vote
2answers
507 views

Can you help me understand this ElasticSearch permissions error?

I'm attempting to make a request to an Elastic.co hosted ElasticSearch instance. I'm receiving this error: AuthorizationException(403, 'security_exception', 'action [indices:monitor/stats] is ...
0
votes
1answer
288 views

Portainer: Pass vm.max_map_count to SonarQube Docker container

I need to set up a SonarQube container on my Portainer instance. SonarQube uses Elasticsearch, which needs a kernel setting passed from the host. This issue is well documented, as mentioned in this ...
0
votes
1answer
5k views

Kibana - "missing authentication credentials for REST request"

I have a elasticsearch cluster with xpack basic license, and native user authentication enabled (with ssl of course). I am attempting to set up kibana on a docker container but keep getting an error ...
0
votes
0answers
292 views

Elasticsearch systemd setup

I am configuring Elasticsearch 2.3.3 (yes, outdated) on CentOS 7.7. We were running it on CentOS 6 with InitV script. I followed this specification to create systemd script and get inspired with the ...
0
votes
1answer
861 views

Can't access Kibana remotely - Can curl successfully on machine

I've installed Kibana on rhel and am I'm trying to access remotely on http://server-url:5601. I've installed elasticsearch and am able to access that remotely on http://server-url:9200 I've added ...
0
votes
0answers
11 views

Adding context paths to ELK log analytics?

I'm looking to install the ELK stack on my application server by following the instructions here: I can see you can then access the various ELK services on localhost via certain ports. Is there a way ...
0
votes
1answer
255 views

Grok filter is not working properly

I have Filebeat-7.1 installed in a Debian server, this Filebeat send data from files in this Debian server to server with Logstash 7.6 , here are the files config Filebeat.yml: #=====================...
0
votes
2answers
108 views

Kibana and Logstash: When is a field not a field?

I've enabled the grok filter in our logstash configuration in order to parse logs from HAProxy using the %{HAPROXYHTTP} and %{HAPROXYTCP} patterns. This seems to work great and viewing the details for ...
1
vote
0answers
233 views

Scaling Elasticsearch down to single-node

Is it possible to scale Elasticsearch from multiple nodes down to one node? I have a 3-node cluster that is way overkill for the amount of data being logged. To scale it down, I set "cluster.routing....
0
votes
1answer
520 views

Does Elasticsearch have capability to form ES cluster with only one ES docker service running multiple replicas of it in Docker-Swarm

I wanna run only one elasticsearch service in docker-swarm having multiple replicas of this service. Does Elasticsearch have capability to form ES cluster with only one ES docker service running ...
2
votes
0answers
97 views

Index rollover latency

I have created an ILM policy as follows, { "policy": { "phases": { "hot": { "min_age": "0ms", "actions": { "rollover": { "max_docs": 30 }, ...
0
votes
1answer
31 views

Do we need a back up of Elastic Search data in a database in case of failure, or is there a solid permanant storage solution with Elastic Search?

We are looking to use Elastic Search in a major software system, which needs financial logs and records kept for many years. We are using Elastic Search, but are a little concerned whether Elastic is ...
1
vote
1answer
164 views

Virtual machine disk I/O latency spikes

Since past few days I have strange I/O spikes in one virtual machine. Its 2.6.32-504.el6.x86_64 #1 SMP Tue Sep 16 01:56:35 EDT 2014 x86_64 x86_64 x86_64 GNU/Linux Red Hat Enterprise Linux Server ...
0
votes
1answer
77 views

Elasticsearch - how to disable client access on data node?

I am fairly new to Elasticsearch and was watching some tutorials that are somewhat outdated. In the tutorial, they said that if one has dedicated data nodes, it is recommended to disable client ...
0
votes
1answer
170 views

Integrating nginx logs and elasticsearch app-search

I'm trying to setup a self-managed docker appsearch instance, together with kibana and elasticsearch, queried by a uvicorn python app, proxied by a nginx webserver My current issue is that the ...
0
votes
1answer
150 views

Pi4+ runs Elasticsearch cluster of 1, gives yellow status

I am currently running Elasticsearch 7.3.2 on a Rasbian (Buster) instance on a Raspberry Pi 4+. It looks like it was running in a green status for a few days, processing files, but suddenly, i ...
0
votes
1answer
458 views

AWS ElasticSearch service does not provide Kibana users management

First I'm going to explain my current architecture. I have an EC2 instance running with a Logstash daemon, as input an http configuration and as output my AWS ElasticSearch instance. As I said before,...
0
votes
0answers
821 views

ELK - Logstash not picking up syslog events

I'm setting up a ELK cluster using Centos 8 and version 7.4 of Elasticsearch, Logstash and Kibana. My issue is with Logstash not picking up the events coming through syslog. Configuring Logstash to ...
0
votes
0answers
531 views

Run OCR in Nextcloud with Docker

I'm using the official Docker image nextcloud:latest to run my Nextcloud instance. I managed to install Elasticsearch (on the host) and created an index. Search works so far. Now I want to OCR PDFs ...
0
votes
0answers
432 views

elastic search behind haproxy

There are 4 elastic search nodes in a cluster and these 4 nodes are setup behind haproxy. Each of the node in the cluster is receiving around 900 to 1000 tcp connections, but one of the node has very ...
1
vote
0answers
114 views

init: logstash main process (19281) terminated with status 1

I run Amazon Linux instance with logstash 6.4.0. [root@****** dragan]# cat /etc/issue Amazon Linux AMI release 2017.03 I wanted to upgrade logstash so I uninstalled 6.4.0 and tried to install 7.3.2. ...
1
vote
0answers
69 views

Is it safe to allow POST access to the multi search API of ElasticSearch

We are running an application using elasticsearch hosted on AWS. The client-side interface uses "ReactiveSearch" for vuejs, which makes POST requests against the "_msearch" interface described here: ...

1
2 3 4 5
8