Questions tagged [zookeeper]

The tag has no usage guidance.

Filter by
Sorted by
Tagged with
0
votes
0answers
8 views

Kafka topic creater details

How to find who created a kafka topic. From the zookeeper I can only see the timestamp of the topic. But I want to know who and how topic got created.
0
votes
1answer
31 views

hadoop + can we install zookeeper servers on kafka hosts

we want to dedicated the zookeeper servers only for kafka machines so each kafka machine include the zookeeper server and zookeeper server will serve only the kafka host and not other application in ...
0
votes
1answer
37 views

Dose zookeeper servers must use SSD disks?

we want to install kafka cluster and 3 zookeeper servers kafka should use the zookeeper servers in order to save the metadata on the zookeeper servers ZK Data and Log files should be on disks, which ...
1
vote
2answers
608 views

ZooKeeper not starting because acceptedEpoch is less than the currentEpoch

I have zookeeper.version=3.4.10, and I see: https://issues.apache.org/jira/browse/ZOOKEEPER-2307 that is however in unresolved status. The problem appeared because of filling up the disk space. Now ...
1
vote
1answer
95 views

Zookeeper best practice - using only SSD disks

we have HDP clusters version 2.6.0 / 2.6.1 ( hortonworks ) , and maybe in the future the version 3.0 I searched a lot in HORTONWORKS documentation , but not found the details about using SSD disks ...
0
votes
0answers
45 views

azure network peering zookeeper timeouts

I'm trying a few things on azure with terraform, but I'm not really used to debug networking and I'm facing an issue. My network looks like : On_premise_Network(196.168.0.0/16) <--- VPN IPsec --->...
0
votes
1answer
961 views

kafka with ACL fails to connect zk and stops

I have a kafka installation (with ssl listener and ssl client authentication). It works fine until I try to add ACL. this is the error (full error in the bottom): [edit-1] the first error on kafka ...
1
vote
2answers
3k views

init script for zookeeper

i have seen that the developers of zookeeper have a great zkServer.sh script to start,stop, restart etc zookeeper, but i have no idea why in the world they decided to skip init script to use. With ...
4
votes
1answer
646 views

Kafka compatible with Zookeeper 3.5 feature 'Rebalancing Client Connections'

In this document https://zookeeper.apache.org/doc/trunk/zookeeperReconfig.html dynamic configuration functionality is described for Zookeeper 3.5. There are 2 important points in this document: ...
2
votes
0answers
1k views

kafka docker - ERROR when sending a message

I would like to implement kafka in a docker container. I use the official zookeper instance for kafka as docker container, too. When I want to write a message about the terminal, on my linux mint 18....
0
votes
1answer
2k views

How to manage failover in ZooKeeper across datacenters using observers

I have an application running in 3 different datacenters that uses ZooKeeper for many tasks. Following the recommended practices, we have deployed three ZooKeeper ensembles where one datacenter ...
1
vote
0answers
82 views

How to make ActiveMQ nodes keep their database synchronized?

I have 3 servers with Zookeeper and ActiveMQ installed. Everything seems to be working fine, however, when one of my node dies, and a new election occurs, however the new leader don't have the same ...
3
votes
1answer
2k views

Why would using MongoDB in lieu of etcd as a key value store be a good or bad idea? [closed]

I'd like to get general thoughts from the community as to why MongoDB for key/value would OR would not be a suitable replacement for etcd or other purpose-built key/value store system (consol, ...
3
votes
1answer
8k views

Get zookeeper cluster status

Is there a cli or some command-line, that I can use to find the zookeeper cluster status. Basically I want to know how to member in cluster or which nodes is acting as a leader. Any pointers will be ...
2
votes
1answer
356 views

Port out of range in ReplicatedDB ActiveMQ

I have 3 replicated machines with Zookeeper and ActiveMQ (linux). I can confirm that zookeeper works correctly since I can see their ports (2888 and 3888) listening via netstat. The problem is ...
0
votes
1answer
541 views

Why does DFSZKFailoverController kills Namenode process in hadoop?

I try to configure hadoop high availability cluster by following this tutorial: http://www.edureka.co/blog/how-to-set-up-hadoop-cluster-with-hdfs-high-availability/ When I follow that article I faces ...
2
votes
0answers
250 views

Restoring Solr Cloud 4.7 index

I have a test environment which is created every morning and then destroyed every night. Part of the environment is a SolrCloud (version 4.7) instance connected to a remote Zookeeper cluster. The ...
4
votes
0answers
133 views

Kafka using a distant Zookeeper instance?

we have an existing Zookeeper instance, and want to build a Kafka cluster in a remote location (not on the same side of the Atlantic ocean). Can we use that existing Zookeeper for our new Kafka usage ...
1
vote
1answer
705 views

Zookeeper - faulty cluster member replacement

I am aware that as long as there is quorum my zookeeper ensemble will keep working. But does the missing server have any notable impact on the cluster performance? Let's suppose 1 of 3 servers ...
2
votes
2answers
5k views

Solrcloud: Error 500 after restart

I have 3 vm windows, on all of them is installed solr 5.4.0 and 3.4.6 zookeeper; the two services start automatically when the vm start. After reboot vms the solr does not respond correctly, it gives ...
1
vote
1answer
42 views

Issuing a single command from a cluster of servers?

I have a cluster of servers that will be running a simple ruok command with fallover. The command will be something simple like curl -X POST http://foo.com/status. Due to the fact that I will have ...
1
vote
1answer
1k views

How to upgrade zookeeper from 3.4.5 to 3.4.6 on Ubuntu 14.04.3

I am having trouble with a zookeeper ensamble where one node is not able to join the quorum. Zookeeper will not join the cluster. How to apply patch/upgrade? This seems to be related to a bug which ...
0
votes
1answer
2k views

Zookeeper will not join the cluster. How to apply patch/upgrade?

I am running a 3 node zookeeper ensemble on ubuntu 14.04. After noticing that node1 was not running, I had to remove the snapshots of this node and now the server did start, but refuses to join the ...
3
votes
1answer
2k views

Zookeeper node is not able to load database on production server anymore

I am running a zookeeper ensemble of 3 on three different ubuntu 14.04 nodes. The setup used to work OK, but now I noticed the zk1 is not operational. It does also not restart: :/home/www$ sudo /etc/...
1
vote
0answers
375 views

Unable to create index on solr, when using Zookeeper

Evening, I've created a what I believe to be a simple SOLR cluster, with Zookeeper (external binaries instead of the embeded). For simplicity, this cluster is: Master: SOLR1 Slave: SOLR2 Both ...
1
vote
1answer
932 views

Gracefully take down a Zookeeper Node

I have had a hard disk begin to fail on one of my Zookeeper nodes in a cluster of 3 nodes. It is only a matter of time until the disk dies completely. Rather than waiting for this, I'd like to remove ...
1
vote
1answer
51 views

Define marathon services listening interface

I have a mesos install with 3 VPS. I use a virtual private network for internal networking. Everytime marathon starts and bind a service to a new port, it binds it to 0.0.0.0. No matter if I had a ...
1
vote
1answer
334 views

How to maintain zookeeper ensemble?

I have a 3 node zookeeper ensemble running from where I had trouble with one node showing a corrupt db. Now I found in the docs that it has to be cleared regularily with the help of cron running this ...
0
votes
2answers
2k views

How to add second ZooKeeper to same machine?

I am running 2 dedicated servers on which I plan to install Solrcloud. I have installed ZooKeeper using apt-get install zookeeperd and ZooKeeper is running on both systems. From solr docs I learned ...
4
votes
4answers
27k views

How can I stop ZooKeeper on Ubuntu?

I have installed zookeeperd on ubuntu 14.04 as suggested here: Unfortunately this process is somehow not stoppable. I tried even kill -9 user@node1:/opt/zookeeper-3.4.6$ ps -ef | grep zookeeper ...
0
votes
1answer
226 views

Why does Accumulo require $ZOOKEEPER_HOME in addition to the IPs of the Zookeeper ensemble?

According to the documentation, Accumulo requires you to set $ZOOKEEPER_HOME (a local path) in the configuration files, and also requires a list of IPs for the Zookeeper ensemble. Why are IPs alone ...
1
vote
1answer
885 views

Error 127 when trying to run Zookeeper through supervisord?

I'm getting (exit status 127; not expected) when I try to run Zookeeper through supervisord, and the errors I'm getting back aren't helpful. Running it as the normal user works just fine: [ec2-user@...
1
vote
2answers
1k views

Apache Kafka 0.8.1.1 clean shutdown not working

I have a: single instance of Apache Kafka (2.9.2-0.8.1.1) installed from the source, using the default configuration (server.properties etc.), Zookeeper (3.4.5+dfsg-2) stand-alone, installed from the ...
0
votes
1answer
5k views

HDFS' ZKFC service unable to start

CDH4's ZooKeeper Failover Controller (ZKFC) has been installed. Starting the ZKFC service: [vagrant@localhost ~]$ sudo service hadoop-hdfs-zkfc start Starting Hadoop zkfc: ...
1
vote
2answers
4k views

Unable to convert HDFS from non-HA to HA

Introduction Aim: Convert HDFS from non-HA to HA. Method: According to this documentation it should be possible to convert HFDS from non- to HA by implementing following configuration: /etc/hadoop/...
21
votes
2answers
33k views

What command needs to be issued to check whether a ZooKeeper server is a Leader or a Follower?

A ZooKeeper Quorum consisting of three ZooKeeper servers has been created. The zoo.cfg located on all three ZooKeeper servers looks as follows: maxClientCnxns=50 # The number of milliseconds of each ...
8
votes
1answer
9k views

Could not start ZK at requested port of 2181, while export HBASE_MANAGES_ZK=false

Problem The first aim was to run HBase standalone. Navigating to ip:60010/master-status is succesfull once HBase has been started. The second aim is to run a distinct ZooKeeper quorum. ZooKeeper has ...
2
votes
2answers
4k views

How to use nagios to monitor Zookeeper nodes

Sorry this may be a basic question, but I am new to both nagios, and zookeeper. My company has an application that uses zookeeper to track job status, by creating/destroying nodes. I need to be able ...
1
vote
1answer
4k views

Apache Kafka consumer client connecting to Apache Zookeeper: EndOfStreamException

I get an error when trying to 'consume' messages from Kafka (2.9.2-0.8.1) with a Zookeer stand-alone (3.4.5). You can see the source code below as well as the error message and logfile from Zookeeper. ...
2
votes
2answers
1k views

Zookeeper starts using bin/zkServer.sh but not with service nor zookeeper-server

On Linux Scientific I have installed ZooKeeper from CDH5. When starting zookeeper using sudo service zookeeper-server start or zookeeper-server start it reports the server running, but fails silently....