The tag has no wiki summary.

learn more… | top users | synonyms

-1
votes
0answers
15 views

Neo4j or elastic search for notification / activity logging on social media site? [closed]

We have a decently active social media site (millions of uniques) and we are trying to decide between neo4j vs elasticsearch db's for managing this particular data. We have gotten a few quotes from 4 ...
0
votes
1answer
63 views

Nothing appearing in kibana dashboard

I have installed Logstash ElasticSearch Kibana on an EC2 instance. I can visit http://example.com:9200 Here I get { "status" : 200, "name" : "Aleta Ogord", "version" : { "number" : ...
0
votes
1answer
76 views

Connection hangs & never connects between ec2 instances over port 9200; fast from outside AWS

I am trying to connect from a web server EC2 instance to an ElasticSearch server ec2 instance. The connection is slow to nonexistent when connecting from the EC2, but very fast when connecting from a ...
2
votes
1answer
138 views

ElasticSearch Server Randomly Stops Working

I have 2 ES servers that are being fed by 1 logstash server and viewing the logs in Kibana. This is a POC to work out any issues before going into production. The system has ran for ~1 month and every ...
-1
votes
1answer
59 views

Elasticsearch throws Could not reserve enough space for object heap

It seems that Elasticsearch stops working this morning. When i launch : sudo service elasticsearch start, it says : Starting ElasticSearch Server Done But when i check the status, it gives me : ...
0
votes
1answer
68 views

Elasticsearch stops working suddenly

I have deployed Elasticsearch on a development ubunto VPS. We use that VPS only to host Api for mobile apps. Everything worked good till today, elasticsearch stops working. I tried to restart it, it ...
0
votes
1answer
97 views

ElasticSearch Multiple Indexes and Routing

Currently I have the following setup. Syslog --> Logstash --> ElasticSearch --> Kibana Logstash is creating a daily index ...
0
votes
0answers
61 views

Output Logstach to Elasticsearch cluster

I have multiple EC2 instances running Logstash and Elasticsearch. I'd like to output everything into ES cluster. output { stdout { debug => true debug_format => "json" } ...
0
votes
1answer
136 views

Multiple instances of Logstash + Elasticsearch on AWS

I have setup a Cloudformation template to start an instance where Logstash and Elasticsearch (not embedded) are installed. I have standard tcp input configured on Logstash and output it to an ...
0
votes
0answers
61 views

graylog elasticsearch install cannot change open file limit on reboot

I have a problem with our graylog 2 install. The elasticsearch process keeps on running out of file handles, this is in the //opt/elasticsearch/logs/graylog2.log log file. [2014-01-09 ...
3
votes
1answer
543 views

Logstash Server Log FIle Flooded With “Failed to flush outgoing items” Error Messages

I'm new to Logstash, trying to get it running following the tutorial in "The Logstash Book". On page 44, the guide suggests to tail the Logstash process' main log file called central.log. After ...
1
vote
1answer
66 views

Securing elasticsearch

There appears to be a serious lack of information on this despite the fact that as installed elasticsearch is extremely exploitable. My main fear in using it is that as a non-expert I have no idea ...
2
votes
1answer
101 views

Logstash Groking Syslog Events

I have a logstash server sending events to an elasticsearch server that is displaying the results in Kibana. Everything is working pretty good, other than Kibana is showing 2 names in the host field. ...
1
vote
1answer
257 views

Elasticsearch standalone mode with logstash reject data after five days

I use Logstash and Elasticsearch for our squid log store and analyze.The size of the logs increase at the speed of 40Gb per day in our freeBSD ZFS storage system. the Elasticsearch gets into failure ...
1
vote
2answers
186 views

expose docker container port to eth0

First: could someone with 300 rep make a tag for "docker" please? TYVM I'm running a docker container for elasticsearch with the following command: docker run -d -i -t -p 9200:9200 -p 9300:9300 ...
0
votes
1answer
75 views

Launch elasticsearch dockerfile using my own elasticsearch.yml

I am launching elasticsearch via a dockerfile found here: https://index.docker.io/u/ehazlett/elasticsearch/ It works great. I need to define my own hosts as my environment does not support ...
1
vote
1answer
295 views

Large virtual memory size of ElasticSearch JVM

I am running a JVM to support ElasticSearch. I am still working on sizing and tuning, so I left the JVM's max heap size at ElasticSearch's default of 1GB. After putting data in the database, I find ...
2
votes
2answers
387 views

Foward slash in kibana 3 query

I'm trying to add a query that will match a request that ends with a slash, like this one: n.n.n.n - - [16/Oct/2013:16:40:41 +0100] "GET / HTTP/1.1" 200 25058 "-" "Mozilla/5.0 (iPad; CPU OS 7_0_2 ...
0
votes
0answers
179 views

Getting strange error from elasticsearch backed of LogStash

When i try to run any query from logstash like "httpd" search from url: http://mydomain.domain.com:9292/search , it gives me following error: "No results for query 'httpd'" And in the log ...
2
votes
1answer
1k views

How well does elasticsearch compress data?

I am looking to scope the servers required for an elasticsearch proof-of-concept. Ultimately, my question is this: Given 1GB of json text indexed by elasticsearch, how much can I expect to be ...
3
votes
1answer
326 views

Adding TTL to elasticsearch with logstash

I can't figure out how to apply this documentation http://www.elasticsearch.org/guide/reference/mapping/ttl-field/ to logstash. Specifically, i don't know which keys to use (instead of "tweet" etc). ...
1
vote
0answers
124 views

How do I enable digest auth for Jetty fronting Elastic Search

We've gotten Jetty running the HTTP front end of Elastic Search with BASIC authentication. We would like to use DIGEST authentication instead, but the Jetty documentation is hard to reconcile with the ...
4
votes
2answers
524 views

Secure logstash and elasticsearch

I'm considering running logstash on my prod server (simple install. http://logstash.net/docs/1.1.13/tutorials/getting-started-simple) and set kibana to access logs. My concern is: how to secure my ...
0
votes
2answers
158 views

Nginx stops serving passenger app (503)

I'm deploying a rails app through passenger and nginx (utilizing an elastic-search server which is running on the same machine) on a Ubuntu system. This works perfectly for about twelve hours. Then, ...
1
vote
0answers
86 views

Elasticsearch and couchdb river indexing slows down after a few hours

Trying to import ~400m docs in to Elasticsearch from couchdb using the couchdb river plugin. Everything starts out great with indexing time around 5k/s but after a few hours come back and find its ...
-1
votes
1answer
199 views

Which apt-get package of java do I install if I want to use elasticsearch?

sudo apt-get install XXX? What java package should I install?
1
vote
1answer
555 views

How much of hardware resource is required for Graylog2? [closed]

We've mounted a graylog2 dedicated server (with a rails unicorn, mongodb and eleasticsearch) on a virtual machine with 2gigs of ram a couple days ago. RAM Consumption just keeps climbing, I am ...
10
votes
1answer
4k views

Scaling Logstash (with redis/elasticsearch)

Over a cluster of over 12 centos 5.8 servers, I deployed logstash using the native logstash shipper, which sends /var/log/*/*.log back to a central logstash server. We tried using rsyslogd as the ...
3
votes
1answer
784 views

Migrating to AWS Cloud with auto-scaling - where to put Redis and ElasticSearch?

I've been trying to research this topic but haven't found anywhere that recommends where to install services such as Redis and ElasticSearch when migrating to a cloud framework. I'm currently running ...
0
votes
2answers
979 views

Elasticsearch won't start anymore

I restarted my elasticsearch instance 5 days ago and I haven't manage to start it since then. I get no output in the log file /var/log/elasticsearch/ nor does the elasticsearch binary print any ...
1
vote
2answers
366 views

Collecting logs from multiple servers in a fault-tolerant way [closed]

the main requirement I have is to be able to view and do simple searches on logs combined from multiple machines. However, I would like the solution to have minimal impact on the rest of the (core) ...
1
vote
1answer
422 views

elasticsearch @ debian6 started by /etc/init.d max_file_descriptors

I have installed elasticsearch @ debian6 by this tutorial. I have set up my system max open files directives so i have these values: # su # cat /proc/sys/fs/file-max 70000 # ulimit -Hn 64000 # ...
1
vote
1answer
157 views

Is it possible to deploy elasticsearch in Webfaction?

I'd like to deploy elasticsearch (ES) at Webfaction server. I have 256MB of memory and running a Django app that takes about 100MB. I need to index about 10,000 records. Is it possible to run ES in a ...
2
votes
1answer
175 views

Disk / system configuration for log collection / syslog server

I am looking into building a syslog / logging infrastructure and am pondering about some architecture best practices. Essentially, I see that a syslog system needs to support two conflicting ...
-1
votes
1answer
147 views

why did i need to stop java software? [closed]

i am on Debian Squeeze, 4G of Ram, 1G of Swap, CPU i3 3.07GHz. I used to use the following java softwares: jenkins elasticsearch Problem was their process was too greedy about CPU, in the top ...
3
votes
3answers
273 views

Simple full-text search server

I have been looking at search solutions like Sphinx, Solr and Elasticsearch but they are all way too complex for what I need. I'm basically looking for a server software, best distributed, that ...
0
votes
1answer
405 views

elasticsearch service wrapper on gentoo

I have elasticsearch installed and working in /opt/elasticsearch. I want to install a service wrapper for it to start/stop/restart it as a service. Elasticsearch recommends using java-service-wrapper: ...
3
votes
2answers
631 views

How to index MySQL from ElasticSearch

Im trying to add some full text searching to my LAMP web application. Ive come across ElasticSearch and I like what it has to offer. I have read the guides and understand how to index a single item by ...
0
votes
1answer
432 views

Loss of data when throwing stuff from logstash to graylog2

The setup is as follows: Syslog sends stuff to logstash logstash parses it to GELF logstash sends it to graylog I know that Logstash uses elasticsearch and so do does graylog and in my setup, the ...
8
votes
1answer
2k views

Recommendations for Elastic Search hardware [closed]

Are there any good guides for hardware level to support ElasticSearch? Are recommendations for Lucene or Solr a good place to start? We're looking at rolling out a deployment starting with 27 ...
3
votes
1answer
1k views

How to secure an Internet-facing Elastic Search implementation in a shared hosting environment?

(Originally asked on StackOverflow, and recommended that I move it here) I've been going over the documentation for Elastic Search and I'm a big fan and I'd like to use it to handle the search for my ...