Elasticsearch is a flexible and powerful open source, distributed, real-time search and analytics engine.

learn more… | top users | synonyms

0
votes
1answer
36 views

No route to host elasticsearch exception

When turning on elasticsearch, I am getting the following configuration error: [2015-04-21 20:49:45,635][INFO ][discovery.zen ] [Blackwulf] failed to send join request to master ...
0
votes
1answer
45 views

Elasticsearch service often goes down or gets killed

My webserver is running ubuntu 14.10 with elasticsearch 1.5.0 and java 1.7u55 For some reason, the elasticsearch service often goes down, resulting in my website not being available to my users ...
1
vote
0answers
35 views

elasticsearch glibc memory corruption

My elastic search clusters keep crashing for no reason. All I can see in the logs is : INFO | jvm 4 | 2015/04/17 19:10:09 | *** glibc detected *** /usr/java/jre1.7.0_04/bin/java: malloc(): ...
2
votes
0answers
45 views

elasticsearch fails periodically on ubuntu with systemd : how to resolve this?

I am using Elasticsearch on Ubuntu 14.10 and it's periodically going down (entering a failed state). When down, this throws exceptions on my website, users can't search, connect or update database ...
0
votes
1answer
10 views

Secure elasticsearch but allow remote CRUD

I'm going to run a bit of software on server A to add and remove entries from elasticsearch on server B. How can I allow these remote create and delete operations, but still keep ES secure? Is ...
0
votes
0answers
11 views

ElasticSearch versus arcsight benchmark comparisons

For those of us looking into huge SIEM implementations, are there any datasheets comparing the benchmarks of arcsight with elastic search. Such benchmarks would include the following: given the same ...
-1
votes
0answers
19 views

How many events per second can one server using elasticsearch handle [duplicate]

How many events per second can elastic search handle using one server? I am researching and cannot find the answer.
2
votes
0answers
68 views

Unable to change vm.max_map_count for elasticsearch

Prehistory I have elasticsearch and SugarCRM7 running on CentOS 6.5. Every day I face the same problem: java outOfMemory error. That happens because of small vm.max_map_count value, 65530 only when ...
2
votes
0answers
39 views

Elasticsearch dies when Logstash attempts to write data

I've got a Raspberry Pi 2 (latest Raspbian as of Apr 2015) setup that last week was running both ElasticSearch and Logstash on a test network (not a straightforward setup, but it was stable for over a ...
0
votes
0answers
29 views

Elastic search custom mysql server

I want to use ElasticSearch nodes with Amazon RDS servers. How I can do this? The idea is to have the ElasticSearch feature only with a remote DB.
2
votes
0answers
57 views

Benchmarking for DISK I/O Writes Per Second - ElasticSearch and MySQL

During working on our project we needed to decide should we use "ElasticSearch" or "MySQL" to record the audit/trail logs of the system. Searching speed is not an issue here, we needed to see the disk ...
0
votes
0answers
30 views

elasticsearch not enabled when installed on additional device

Here's the deal : I'm working with AWS EC2 instances (Centos 7). Elasticsearch is installed from the sources in the folder /app. The elasticsearch service is managed by init.d. The problem is that if ...
0
votes
2answers
96 views

elasticsearch-river-jdbc inserting duplicate record in mysql db

Sorry I am newbie to Elasticsearch and I am using elasticsearch-river-jdbc to connect to myql database,everything is working fine except for the fact that everytime it run as per schedule its ...
0
votes
1answer
55 views

Is it generally a bad idea to run MongoDB and ElasticSerach on the same nodes

Simple question: is it stupid to run mongodb and elasticsearch on the same nodes within a cluster of three if you take care of mongodb's memory hunger using cgroups and ignore the aspect of concurring ...
2
votes
0answers
43 views

Using database for storing text files and images [closed]

I need to build a image/static file cache which would host maybe few hundred up to thousand static files from 1kb to ~200kb. I'd need super fast reads (I'm using redis, but it's one threaded and I'm ...
0
votes
0answers
170 views

Install logstash forwarder

Any body please help me how to install logstash forwarder in 12.04 ubuntu version? I followed logstash book to install forwarder I got some ruby error these are the steps i followed $ sudo ...
0
votes
0answers
33 views

What the best practices to import Elasticsearch indices

I am running an elasticsearch cluster of 5 nodes in a production subnetwork, it's a "front" cluster with lot of search/read operations (DNS es-1.data.prod, es-2.data.prod and so on). In an other side, ...
6
votes
2answers
175 views

Sending Subversion logs to Logstash

My requirement is to send subversion logs(i.e username,revision number...) to logstash for parsing(then store it in elastic search and finally displayed it via kibana).Since subversion use its own ...
2
votes
1answer
214 views

Elasticsearch performance tuning

In a Single Node Elastic Search along with logstash, We tested with 20mb and 200mb file parsing to Elastic Search on Different types of the AWS instance i.e Medium, Large and Xlarge. Logstash conf ...
0
votes
0answers
50 views

How parse a multiple objects serialized in log with logstash and grok

I'm parsing some log files with grok, but I have the following trace: [es.org.some.Object[ attr1=53212 searchTags=[love, rock] ]] [es.org.some.Object[ attr1=54612 searchTags=[love, peace, rock] ...
6
votes
0answers
71 views

Is there disk based file system with dedicated memory caching for Linux? [closed]

We have two (or more sometimes) applications battling for the OS page cache. In particular ElasticSearch is very dependent on the OS page cache. To the point that cache misses can make or break ...
0
votes
1answer
432 views

Error while setting up grafana with graphite and nginx

While trying to setup grafana with graphite using nginx server. I am getting this error: No 'Access-Control-Allow-Origin' header is present on the requested resource. I tried changing configuration ...
2
votes
2answers
1k views

Error Could not contact Elasticsearch at http://localhost:9200. - kibana dashboard

'Error Could not contact Elasticsearch at http://localhost:9200. Please ensure that Elasticsearch is reachable from your system.' Currently I am following http://packetbeat.com/getstarted I ...
2
votes
2answers
95 views

Elasticsearch index much larger than the actual size of the logs it indexed?

I noticed that elasticsearch consumed over 30GB of disk space over night. By comparison the total size of all the logs I wanted to index is only 5 GB...Well, not even that really, probably more like ...
0
votes
0answers
46 views

ElasticSearch snapshot backup sliding expiration - possible?

I'm planning on using the ElasticSearch S3 cloud plugin to create snapshots of our ES cluster. This all looks fairly straight forward but I'm wondering whether its possible integrate it into our ...
0
votes
0answers
114 views

Why doesn't logstash grab or index the files from the mapped drive?

I don't understand why logstash is so finicky with network resources. I shared a folder on another machine and then mapped it as Z: under Windows Explorer. I've verified the path and everything. I can ...
1
vote
1answer
257 views

How to rename and join an elasticsearch server preserving data?

I tested elasticsearch and decided to make a cluster. To this I renamed the node and defined a cluster cluster.name = mycluster node.name = firstnode When restarting the changes are taken into ...
0
votes
2answers
277 views

What is the purpose of elasticsearch logs? How to manage them?

As I understand indexes(or data) are being stored in /var/lib/elasticsearch by default, this folder contains nodes with 0 and 1 folders and overall size of these folders is 376M. The logs are ...
1
vote
2answers
270 views

Elasticsearch as memcache replacement

I am looking into replacing memcached with elasticsearch. Basically, I need to reduce my software stack and since I will be using elastic for searching, I was thinking of creating an index that will ...
0
votes
1answer
30 views

Access the JVM section of elasticsearch through the monitoring API

How I can access the jvm section of the node stats API ? I've read about it in the docs - monitoring individual nodes I'm doing a call to /_nodes/stats?pretty=true but don't have the jvm ...
-1
votes
1answer
59 views

Statistical information regarding scaling ElasticSearch [duplicate]

I have a set-up with several Logstash nodes sending input to ElasticSearch, and have a kibana server which allows me to visualize this. The current infrastructure is pretty simplistic and is on ...
0
votes
0answers
248 views

Kibana not finding local files e.g. require JS, CSS

I'm new to linux/ubuntu and the ELK stack and having an issue getting kibana to work. I've unpacked all three into this folder and started kibana and elastic search: cd /home/ubuntu ls ...
1
vote
0answers
1k views

logstash / kibana can't connect to instance

I don't remember changing anything at all on my logstash server. As of just yesterday it was working fine! And I used it to run some queries. However.. today when I went to my logstash page, I see ...
0
votes
1answer
774 views

kibana: no indices error

None of the existing answers helped, so here a new question. Usecase: Redirecting syslog (or) monitoring static file. I have successfully installed logstash (1.4.2), elasticsearch(1.1.1) and ...
0
votes
1answer
436 views

Elasticsearch River JDBC - Avoiding 'SELECT *'

I'd like to syncronize some MySQL tables to an ElasticSearch index, you know, for search. But almost every examples I can find show a big bad fat "SELECT * FROM", it's OK for an example, but I'm in ...
0
votes
0answers
68 views

ElasticSearch cluster with remote nodes

Introduction Right now, I have three ElasticSearch servers (in Germany, US and Middle East(ME)). Each one has the same indexes but different data (they collect logs from local servers). Goal I want ...
0
votes
0answers
130 views

Reduce Elasticsearch log level

I have been trying to reduce the number of messages being logged by elastic search, however no matter what levels i put on each value (WARN, ERROR) i always see alot of DEBUG/WARN messages... I want ...
2
votes
1answer
4k views

Elasticsearch is using way too much disk space

I have a CentOS 6.5 server on which I installed Elasticsearch 1.3.2. My elasticsearch.yml configuration file is a minimal modification of the one shipping with elasticsearch as a default. Once ...
0
votes
0answers
251 views

Logstash/collectd buffer to files on network fault

I have read this: http://logstash.net/docs/1.4.2/life-of-an-event An example setup: collectd ( on local machine ) ----[via UDP]---> logstash (on local machine) ---[via elasticsearch output ...
0
votes
0answers
254 views

Kopf can not access elasticsearch

I have a setup with ElasticSearch, Logstash and Kibana working. With Kibana, I can access the data of the ElasticSearch from a remote host. I installed the latest kopf plugin with : ...
0
votes
1answer
7k views

Configure Nginx, Kibana, Elasticsearch

My setup Nginx + Kibana - same box different domain, sub-domain (nginx - example.com, kibana - kibana.example.com) Elasticsearch - 192.168.100.31 I have used the config defined below. Replaced ...
-2
votes
1answer
160 views

How do I know how the hacker gained access to my machine? [duplicate]

I own a dedicated machine and today I got an email from my host saying that my server will be blocked if I don't stop abusing the network. I am not a spammer or hacker. Someone was using my machine to ...
2
votes
1answer
171 views

ES fills up heap slowly over time and hangs at 14GB, while biggest index is 164MB?

I have an issue with Elasticsearch, at some times, it tries to run GC continously since this one is unable to free because heap size set to 14GB (min and max) is said to be completely allocated: ...
0
votes
0answers
34 views

ElasticSearch mappings for Apache URLs

So I'm feeding Apache access logs into my ElasticSearch cluster, but those darned developers keep crashing my cluster with their ad-hoc queries. Can anyone share what they're using to facilitate ...
1
vote
1answer
1k views

Installing Graylog2 with puppet

I have manged to install Graylog2 from scratch by downloading all the DEB files and making the configurations. Now I try to install Graylog2 with the help of puppet in an environment and had no luck ...
0
votes
1answer
429 views

How can I add basic auth to an apache proxy while using CORS headers?

Background I use grafana for displaying graphs of our server-metrics. Grafana is a JS-app which in our case is getting the data from graphite and storing search-queries in elasticsearch. All three ...
1
vote
0answers
382 views

ElasticSearch major slowdown upon big aggregations

My goal is to use ElasticSearch v1.3.2 for analyzing product cross-sales, so I need to filter for the receipts of interest (having an alcoholic product for example) and finding top selling products of ...
1
vote
0answers
444 views

JVM process resident set size “equals” max heap size, not current heap size

After a few reading about jvm memory (here, here, here, others I forgot...), I am expecting the resident set size of my java process to be roughly equal to the current heap space capacity. That's not ...
0
votes
1answer
630 views

Could not access pid file for elasticsearch

I am not a die-hard linux engineer, but I am having some problems with starting Elastic Search. Some stats: Server: Ubuntu Server 11.04 Elastic Search: 1.2.3 (installed with appitude) When I start ...
0
votes
1answer
105 views

Monitoring solution that doesn't duplicate source data?

I need to analyze data stored in multiple databases. Each of them contains a few TB of logs and sensor data. If I use Splunk or ElasticSearch/Kibana, I see 2 solutions: Batch import everything ...