Elasticsearch is a flexible and powerful open source, distributed, real-time search and analytics engine.

learn more… | top users | synonyms

0
votes
1answer
14 views

Stopping an Elasticsearch snapshot

We do nightly snapshots to S3. They normally take ~2hrs. I have one that has been running for 4 days now. I've tried to stop it with this command: time curl -XDELETE -s ...
0
votes
1answer
20 views

Elastic Search Unassigned Shards

I setup elastic search cluster with 2 nodes with node1 and node2.I used default configuration and setup clusture.name and node.name with multicast disabled and unicast enabled and rest configurations ...
4
votes
1answer
67 views

Elasticsearch: High traffic on loopback interface

One of our application uses Elasticsearch (1.4.4) as an in-memory cache. The application is a Java webapp deployed on Tomcat 7 with Oracle 1.7. The elasticsearch instance is a one-node setup deployed ...
0
votes
1answer
44 views

Is it possible to access Kibana (Elasticsearch) via ssh tunnel?

I am trying to acces kibana from a remote machine through an SSH tunnel: $ ssh -f user@elastichost -L 5601:elastichost:5601 -N My remote browser just timesout waiting for a response. Is there a ...
-1
votes
0answers
48 views

Elastic Search Not Starting

I have installed ElasticSearch Version 1.5.x on Centos using yum repository.Elastic Search got successfully installed but when i start using /etc/init.d/elasticsearch start it give me following error: ...
2
votes
0answers
22 views

Shutting down elasticsearch completely?

I have found a number of posts about shutting down a node or a cluster of nodes, but what about stopping all elasticsearch processes on a machine? Even after shutting down all nodes (curl -XPOST ...
1
vote
0answers
26 views

IDS (or similar) to query ELK logs and send alarms on strange situations [closed]

I have an ELK stack (that receives logs from mostly web services,web applications). I'd like to not only store and visualize some stats about the logs(features of ELK) but also to use them to detect ...
0
votes
1answer
142 views

No route to host elasticsearch exception

When turning on elasticsearch, I am getting the following configuration error: [2015-04-21 20:49:45,635][INFO ][discovery.zen ] [Blackwulf] failed to send join request to master ...
0
votes
1answer
85 views

Elasticsearch service often goes down or gets killed

My webserver is running ubuntu 14.10 with elasticsearch 1.5.0 and java 1.7u55 For some reason, the elasticsearch service often goes down, resulting in my website not being available to my users ...
1
vote
0answers
42 views

elasticsearch glibc memory corruption

My elastic search clusters keep crashing for no reason. All I can see in the logs is : INFO | jvm 4 | 2015/04/17 19:10:09 | *** glibc detected *** /usr/java/jre1.7.0_04/bin/java: malloc(): ...
2
votes
0answers
80 views

elasticsearch fails periodically on ubuntu with systemd : how to resolve this?

I am using Elasticsearch on Ubuntu 14.10 and it's periodically going down (entering a failed state). When down, this throws exceptions on my website, users can't search, connect or update database ...
0
votes
1answer
21 views

Secure elasticsearch but allow remote CRUD

I'm going to run a bit of software on server A to add and remove entries from elasticsearch on server B. How can I allow these remote create and delete operations, but still keep ES secure? Is ...
0
votes
0answers
20 views

ElasticSearch versus arcsight benchmark comparisons

For those of us looking into huge SIEM implementations, are there any datasheets comparing the benchmarks of arcsight with elastic search. Such benchmarks would include the following: given the same ...
2
votes
0answers
198 views

Unable to change vm.max_map_count for elasticsearch

Prehistory I have elasticsearch and SugarCRM7 running on CentOS 6.5. Every day I face the same problem: java outOfMemory error. That happens because of small vm.max_map_count value, 65530 only when ...
2
votes
0answers
55 views

Elasticsearch dies when Logstash attempts to write data

I've got a Raspberry Pi 2 (latest Raspbian as of Apr 2015) setup that last week was running both ElasticSearch and Logstash on a test network (not a straightforward setup, but it was stable for over a ...
0
votes
0answers
34 views

Elastic search custom mysql server

I want to use ElasticSearch nodes with Amazon RDS servers. How I can do this? The idea is to have the ElasticSearch feature only with a remote DB.
2
votes
0answers
86 views

Benchmarking for DISK I/O Writes Per Second - ElasticSearch and MySQL

During working on our project we needed to decide should we use "ElasticSearch" or "MySQL" to record the audit/trail logs of the system. Searching speed is not an issue here, we needed to see the disk ...
0
votes
0answers
33 views

elasticsearch not enabled when installed on additional device

Here's the deal : I'm working with AWS EC2 instances (Centos 7). Elasticsearch is installed from the sources in the folder /app. The elasticsearch service is managed by init.d. The problem is that if ...
0
votes
2answers
128 views

elasticsearch-river-jdbc inserting duplicate record in mysql db

Sorry I am newbie to Elasticsearch and I am using elasticsearch-river-jdbc to connect to myql database,everything is working fine except for the fact that everytime it run as per schedule its ...
0
votes
1answer
69 views

Is it generally a bad idea to run MongoDB and ElasticSerach on the same nodes

Simple question: is it stupid to run mongodb and elasticsearch on the same nodes within a cluster of three if you take care of mongodb's memory hunger using cgroups and ignore the aspect of concurring ...
2
votes
0answers
50 views

Using database for storing text files and images [closed]

I need to build a image/static file cache which would host maybe few hundred up to thousand static files from 1kb to ~200kb. I'd need super fast reads (I'm using redis, but it's one threaded and I'm ...
0
votes
0answers
201 views

Install logstash forwarder

Any body please help me how to install logstash forwarder in 12.04 ubuntu version? I followed logstash book to install forwarder I got some ruby error these are the steps i followed $ sudo ...
0
votes
0answers
38 views

What the best practices to import Elasticsearch indices

I am running an elasticsearch cluster of 5 nodes in a production subnetwork, it's a "front" cluster with lot of search/read operations (DNS es-1.data.prod, es-2.data.prod and so on). In an other side, ...
6
votes
2answers
196 views

Sending Subversion logs to Logstash

My requirement is to send subversion logs(i.e username,revision number...) to logstash for parsing(then store it in elastic search and finally displayed it via kibana).Since subversion use its own ...
2
votes
1answer
330 views

Elasticsearch performance tuning

In a Single Node Elastic Search along with logstash, We tested with 20mb and 200mb file parsing to Elastic Search on Different types of the AWS instance i.e Medium, Large and Xlarge. Logstash conf ...
0
votes
0answers
54 views

How parse a multiple objects serialized in log with logstash and grok

I'm parsing some log files with grok, but I have the following trace: [es.org.some.Object[ attr1=53212 searchTags=[love, rock] ]] [es.org.some.Object[ attr1=54612 searchTags=[love, peace, rock] ...
6
votes
0answers
73 views

Is there disk based file system with dedicated memory caching for Linux? [closed]

We have two (or more sometimes) applications battling for the OS page cache. In particular ElasticSearch is very dependent on the OS page cache. To the point that cache misses can make or break ...
0
votes
1answer
582 views

Error while setting up grafana with graphite and nginx

While trying to setup grafana with graphite using nginx server. I am getting this error: No 'Access-Control-Allow-Origin' header is present on the requested resource. I tried changing configuration ...
2
votes
2answers
2k views

Error Could not contact Elasticsearch at http://localhost:9200. - kibana dashboard

'Error Could not contact Elasticsearch at http://localhost:9200. Please ensure that Elasticsearch is reachable from your system.' Currently I am following http://packetbeat.com/getstarted I ...
1
vote
2answers
103 views

Elasticsearch index much larger than the actual size of the logs it indexed?

I noticed that elasticsearch consumed over 30GB of disk space over night. By comparison the total size of all the logs I wanted to index is only 5 GB...Well, not even that really, probably more like ...
0
votes
0answers
56 views

ElasticSearch snapshot backup sliding expiration - possible?

I'm planning on using the ElasticSearch S3 cloud plugin to create snapshots of our ES cluster. This all looks fairly straight forward but I'm wondering whether its possible integrate it into our ...
-1
votes
1answer
163 views

Why doesn't logstash grab or index the files from the mapped drive?

I don't understand why logstash is so finicky with network resources. I shared a folder on another machine and then mapped it as Z: under Windows Explorer. I've verified the path and everything. I can ...
1
vote
1answer
321 views

How to rename and join an elasticsearch server preserving data?

I tested elasticsearch and decided to make a cluster. To this I renamed the node and defined a cluster cluster.name = mycluster node.name = firstnode When restarting the changes are taken into ...
0
votes
2answers
403 views

What is the purpose of elasticsearch logs? How to manage them?

As I understand indexes(or data) are being stored in /var/lib/elasticsearch by default, this folder contains nodes with 0 and 1 folders and overall size of these folders is 376M. The logs are ...
1
vote
2answers
302 views

Elasticsearch as memcache replacement

I am looking into replacing memcached with elasticsearch. Basically, I need to reduce my software stack and since I will be using elastic for searching, I was thinking of creating an index that will ...
0
votes
1answer
34 views

Access the JVM section of elasticsearch through the monitoring API

How I can access the jvm section of the node stats API ? I've read about it in the docs - monitoring individual nodes I'm doing a call to /_nodes/stats?pretty=true but don't have the jvm ...
-1
votes
1answer
68 views

Statistical information regarding scaling ElasticSearch [duplicate]

I have a set-up with several Logstash nodes sending input to ElasticSearch, and have a kibana server which allows me to visualize this. The current infrastructure is pretty simplistic and is on ...
0
votes
0answers
268 views

Kibana not finding local files e.g. require JS, CSS

I'm new to linux/ubuntu and the ELK stack and having an issue getting kibana to work. I've unpacked all three into this folder and started kibana and elastic search: cd /home/ubuntu ls ...
1
vote
0answers
1k views

logstash / kibana can't connect to instance

I don't remember changing anything at all on my logstash server. As of just yesterday it was working fine! And I used it to run some queries. However.. today when I went to my logstash page, I see ...
0
votes
1answer
945 views

kibana: no indices error

None of the existing answers helped, so here a new question. Usecase: Redirecting syslog (or) monitoring static file. I have successfully installed logstash (1.4.2), elasticsearch(1.1.1) and ...
0
votes
1answer
484 views

Elasticsearch River JDBC - Avoiding 'SELECT *'

I'd like to syncronize some MySQL tables to an ElasticSearch index, you know, for search. But almost every examples I can find show a big bad fat "SELECT * FROM", it's OK for an example, but I'm in ...
0
votes
0answers
75 views

ElasticSearch cluster with remote nodes

Introduction Right now, I have three ElasticSearch servers (in Germany, US and Middle East(ME)). Each one has the same indexes but different data (they collect logs from local servers). Goal I want ...
0
votes
0answers
147 views

Reduce Elasticsearch log level

I have been trying to reduce the number of messages being logged by elastic search, however no matter what levels i put on each value (WARN, ERROR) i always see alot of DEBUG/WARN messages... I want ...
2
votes
1answer
4k views

Elasticsearch is using way too much disk space

I have a CentOS 6.5 server on which I installed Elasticsearch 1.3.2. My elasticsearch.yml configuration file is a minimal modification of the one shipping with elasticsearch as a default. Once ...
0
votes
0answers
277 views

Logstash/collectd buffer to files on network fault

I have read this: http://logstash.net/docs/1.4.2/life-of-an-event An example setup: collectd ( on local machine ) ----[via UDP]---> logstash (on local machine) ---[via elasticsearch output ...
0
votes
0answers
302 views

Kopf can not access elasticsearch

I have a setup with ElasticSearch, Logstash and Kibana working. With Kibana, I can access the data of the ElasticSearch from a remote host. I installed the latest kopf plugin with : ...
0
votes
1answer
7k views

Configure Nginx, Kibana, Elasticsearch

My setup Nginx + Kibana - same box different domain, sub-domain (nginx - example.com, kibana - kibana.example.com) Elasticsearch - 192.168.100.31 I have used the config defined below. Replaced ...
-2
votes
1answer
167 views

How do I know how the hacker gained access to my machine? [duplicate]

I own a dedicated machine and today I got an email from my host saying that my server will be blocked if I don't stop abusing the network. I am not a spammer or hacker. Someone was using my machine to ...
2
votes
1answer
205 views

ES fills up heap slowly over time and hangs at 14GB, while biggest index is 164MB?

I have an issue with Elasticsearch, at some times, it tries to run GC continously since this one is unable to free because heap size set to 14GB (min and max) is said to be completely allocated: ...
0
votes
0answers
41 views

ElasticSearch mappings for Apache URLs

So I'm feeding Apache access logs into my ElasticSearch cluster, but those darned developers keep crashing my cluster with their ad-hoc queries. Can anyone share what they're using to facilitate ...