Questions tagged [zookeeper]

The tag has no usage guidance.

Filter by
Sorted by
Tagged with
0 votes
0 answers
88 views

Apache Kafka Kraft best practices and what is the preferred disk storage for the meta-data topic

My question concerns the recommended disk storage for the topic __cluster_metadata-0 under controllers in Kraft mode. we have two options: Locate the topic __cluster_metadata-0 , on OS volume as /...
King David's user avatar
0 votes
0 answers
40 views

ZooKeeper error ; unrecognized host name for local configuration

I am using Kylin 4+ and want to use Windows and run it locally (without Hadoop). I follow this tut in their website which states that zookeeper config must be set to local like so: kylin.env.zookeeper-...
Martin Moore's user avatar
0 votes
0 answers
49 views

How to enable TLSv1.3 on Zookeeper 3.8

I had set the below properties in zoo.cfg to enable TLSv1.3 on zookeper 3.8.0 , but in the logs I see that zookeeper is connected to other zookeeper node on TLSv1.2 that is the default version. I want ...
kapil shewate's user avatar
0 votes
1 answer
99 views

Can I use Zookeeper 3.7.1 with Solr 7.7.3?

Each version of Solr ships with a version of Zookeeper. Solr's docs say that you should upgrade Zookeeper if you upgrade Solr, but can you upgrade Zookeeper to a later version that is shipped with ...
ChimneyImp's user avatar
0 votes
0 answers
133 views

What are the risks in running single Zookeeper instance in production?

I'm considering using Zookeeper to manage shared configuration across multiple services that live on a single application server. Usage would be very low volume, mostly reads. My production system ...
Remi Despres-Smyth's user avatar
1 vote
1 answer
1k views

zookeeper ssl alert "alert bad certificate"

I am using Kafka (version 2.3.0) and Zookeeper (version 3.5.5-3) - the stable version is 3.6.3. When I test the SSL of my Zookeeper using this command: openssl s_client -showcerts -connect 127.0.0.1:...
John Mark's user avatar
1 vote
0 answers
635 views

Zookeeper ensemble leader reporting incorrect number of followers

I have a zookeeper ensemble running in Kubernetes consisting of 3 instances. The ensemble operates mostly correctly and successfully services the Solr cluster it is backing. One thing does seem ...
Taz's user avatar
  • 147
1 vote
0 answers
451 views

How can I further analyze ram usage in a possible leak? [debian@HyperV + Kafka + Zookeeper]

We have a 3-box cluster Kafka+Zookeeper, in a virtualized enviroment (in Windows 2019 HyperV). In the machines' config dynamic memory is disabled, and they have 4G RAM each (I know it's a very few ...
Mise's user avatar
  • 11
0 votes
1 answer
1k views

How set a fixed private IP for ECS containers?

I have a Task Definition called kafka-zookeeper, it has an Apache Kafka broker and a Zookeeper node in it. Those containers need to communicate with each other (that's easy) and with the kafka and ...
ItsaMeTuni's user avatar
16 votes
9 answers
36k views

Unable to start kafka with zookeeper (kafka.common.InconsistentClusterIdException)

Below the steps I did to get this issue : Launch ZooKeeper Launch Kafka : .\bin\windows\kafka-server-start.bat .\config\server.properties Also note that my OS is Windows And at the second step ...
TourEiffel's user avatar
0 votes
0 answers
2k views

zookeeper server due unable to load database on disk

We have kafka cluster with 3 nodes , each kafka include zookeeper server and schema registry We get the following error on one of the zookeeper server [2019-11-12 07:44:20,719] ERROR Unable to load ...
shalom's user avatar
  • 501
0 votes
1 answer
308 views

hadoop + can we install zookeeper servers on kafka hosts

we want to dedicated the zookeeper servers only for kafka machines so each kafka machine include the zookeeper server and zookeeper server will serve only the kafka host and not other application in ...
shalom's user avatar
  • 501
0 votes
1 answer
245 views

Dose zookeeper servers must use SSD disks?

we want to install kafka cluster and 3 zookeeper servers kafka should use the zookeeper servers in order to save the metadata on the zookeeper servers ZK Data and Log files should be on disks, which ...
shalom's user avatar
  • 501
2 votes
3 answers
9k views

ZooKeeper not starting because acceptedEpoch is less than the currentEpoch

I have zookeeper.version=3.4.10, and I see: https://issues.apache.org/jira/browse/ZOOKEEPER-2307 that is however in unresolved status. The problem appeared because of filling up the disk space. Now ...
hdjur_jcv's user avatar
  • 201
1 vote
1 answer
383 views

Zookeeper best practice - using only SSD disks

we have HDP clusters version 2.6.0 / 2.6.1 ( hortonworks ) , and maybe in the future the version 3.0 I searched a lot in HORTONWORKS documentation , but not found the details about using SSD disks ...
shalom's user avatar
  • 501
0 votes
1 answer
5k views

kafka with ACL fails to connect zk and stops

I have a kafka installation (with ssl listener and ssl client authentication). It works fine until I try to add ACL. this is the error (full error in the bottom): [edit-1] the first error on kafka ...
ozma's user avatar
  • 121
1 vote
2 answers
5k views

init script for zookeeper

i have seen that the developers of zookeeper have a great zkServer.sh script to start,stop, restart etc zookeeper, but i have no idea why in the world they decided to skip init script to use. With ...
uberrebu's user avatar
  • 513
4 votes
1 answer
2k views

Kafka compatible with Zookeeper 3.5 feature 'Rebalancing Client Connections'

In this document https://zookeeper.apache.org/doc/trunk/zookeeperReconfig.html dynamic configuration functionality is described for Zookeeper 3.5. There are 2 important points in this document: ...
hendrikswan's user avatar
2 votes
0 answers
2k views

kafka docker - ERROR when sending a message

I would like to implement kafka in a docker container. I use the official zookeper instance for kafka as docker container, too. When I want to write a message about the terminal, on my linux mint 18....
Volker Raschek's user avatar
0 votes
1 answer
3k views

How to manage failover in ZooKeeper across datacenters using observers

I have an application running in 3 different datacenters that uses ZooKeeper for many tasks. Following the recommended practices, we have deployed three ZooKeeper ensembles where one datacenter ...
Matheus Portela's user avatar
2 votes
0 answers
102 views

How to make ActiveMQ nodes keep their database synchronized?

I have 3 servers with Zookeeper and ActiveMQ installed. Everything seems to be working fine, however, when one of my node dies, and a new election occurs, however the new leader don't have the same ...
Valter Silva's user avatar
5 votes
1 answer
3k views

Why would using MongoDB in lieu of etcd as a key value store be a good or bad idea? [closed]

I'd like to get general thoughts from the community as to why MongoDB for key/value would OR would not be a suitable replacement for etcd or other purpose-built key/value store system (consol, ...
DefionsCode's user avatar
15 votes
1 answer
45k views

Get zookeeper cluster status

Is there a cli or some command-line, that I can use to find the zookeeper cluster status. Basically I want to know how to member in cluster or which nodes is acting as a leader. Any pointers will be ...
Sumit Murari's user avatar
2 votes
1 answer
973 views

Port out of range in ReplicatedDB ActiveMQ

I have 3 replicated machines with Zookeeper and ActiveMQ (linux). I can confirm that zookeeper works correctly since I can see their ports (2888 and 3888) listening via netstat. The problem is ...
sweet suman's user avatar
0 votes
1 answer
832 views

Why does DFSZKFailoverController kills Namenode process in hadoop?

I try to configure hadoop high availability cluster by following this tutorial: http://www.edureka.co/blog/how-to-set-up-hadoop-cluster-with-hdfs-high-availability/ When I follow that article I faces ...
Oleksandr's user avatar
  • 763
2 votes
0 answers
321 views

Restoring Solr Cloud 4.7 index

I have a test environment which is created every morning and then destroyed every night. Part of the environment is a SolrCloud (version 4.7) instance connected to a remote Zookeeper cluster. The ...
wimnat's user avatar
  • 299
4 votes
0 answers
144 views

Kafka using a distant Zookeeper instance?

we have an existing Zookeeper instance, and want to build a Kafka cluster in a remote location (not on the same side of the Atlantic ocean). Can we use that existing Zookeeper for our new Kafka usage ...
Pixou's user avatar
  • 141
1 vote
1 answer
995 views

Zookeeper - faulty cluster member replacement

I am aware that as long as there is quorum my zookeeper ensemble will keep working. But does the missing server have any notable impact on the cluster performance? Let's suppose 1 of 3 servers ...
fiction's user avatar
  • 173
2 votes
2 answers
7k views

Solrcloud: Error 500 after restart

I have 3 vm windows, on all of them is installed solr 5.4.0 and 3.4.6 zookeeper; the two services start automatically when the vm start. After reboot vms the solr does not respond correctly, it gives ...
kasher's user avatar
  • 73
1 vote
1 answer
50 views

Issuing a single command from a cluster of servers?

I have a cluster of servers that will be running a simple ruok command with fallover. The command will be something simple like curl -X POST http://foo.com/status. Due to the fact that I will have ...
ehime's user avatar
  • 597
1 vote
1 answer
3k views

How to upgrade zookeeper from 3.4.5 to 3.4.6 on Ubuntu 14.04.3

I am having trouble with a zookeeper ensamble where one node is not able to join the quorum. Zookeeper will not join the cluster. How to apply patch/upgrade? This seems to be related to a bug which ...
merlin's user avatar
  • 2,172
0 votes
1 answer
3k views

Zookeeper will not join the cluster. How to apply patch/upgrade?

I am running a 3 node zookeeper ensemble on ubuntu 14.04. After noticing that node1 was not running, I had to remove the snapshots of this node and now the server did start, but refuses to join the ...
merlin's user avatar
  • 2,172
3 votes
1 answer
4k views

Zookeeper node is not able to load database on production server anymore

I am running a zookeeper ensemble of 3 on three different ubuntu 14.04 nodes. The setup used to work OK, but now I noticed the zk1 is not operational. It does also not restart: :/home/www$ sudo /etc/...
merlin's user avatar
  • 2,172
1 vote
0 answers
630 views

Unable to create index on solr, when using Zookeeper

Evening, I've created a what I believe to be a simple SOLR cluster, with Zookeeper (external binaries instead of the embeded). For simplicity, this cluster is: Master: SOLR1 Slave: SOLR2 Both ...
The NinjaSysadmin's user avatar
1 vote
1 answer
2k views

Gracefully take down a Zookeeper Node

I have had a hard disk begin to fail on one of my Zookeeper nodes in a cluster of 3 nodes. It is only a matter of time until the disk dies completely. Rather than waiting for this, I'd like to remove ...
BlackVegetable's user avatar
1 vote
1 answer
61 views

Define marathon services listening interface

I have a mesos install with 3 VPS. I use a virtual private network for internal networking. Everytime marathon starts and bind a service to a new port, it binds it to 0.0.0.0. No matter if I had a ...
Dimitri Kopriwa's user avatar
1 vote
1 answer
491 views

How to maintain zookeeper ensemble?

I have a 3 node zookeeper ensemble running from where I had trouble with one node showing a corrupt db. Now I found in the docs that it has to be cleared regularily with the help of cron running this ...
merlin's user avatar
  • 2,172
0 votes
2 answers
3k views

How to add second ZooKeeper to same machine?

I am running 2 dedicated servers on which I plan to install Solrcloud. I have installed ZooKeeper using apt-get install zookeeperd and ZooKeeper is running on both systems. From solr docs I learned ...
merlin's user avatar
  • 2,172
6 votes
4 answers
44k views

How can I stop ZooKeeper on Ubuntu?

I have installed zookeeperd on Ubuntu 14.04 (Trusty Tahr) as suggested here: Unfortunately this process is somehow not stoppable. I tried even kill -9 user@node1:/opt/zookeeper-3.4.6$ ps -ef | ...
merlin's user avatar
  • 2,172
0 votes
1 answer
294 views

Why does Accumulo require $ZOOKEEPER_HOME in addition to the IPs of the Zookeeper ensemble?

According to the documentation, Accumulo requires you to set $ZOOKEEPER_HOME (a local path) in the configuration files, and also requires a list of IPs for the Zookeeper ensemble. Why are IPs alone ...
Ianvdl's user avatar
  • 45
1 vote
1 answer
2k views

Error 127 when trying to run Zookeeper through supervisord?

I'm getting (exit status 127; not expected) when I try to run Zookeeper through supervisord, and the errors I'm getting back aren't helpful. Running it as the normal user works just fine: [ec2-user@...
greggilbert's user avatar
1 vote
2 answers
2k views

Apache Kafka 0.8.1.1 clean shutdown not working

I have a: single instance of Apache Kafka (2.9.2-0.8.1.1) installed from the source, using the default configuration (server.properties etc.), Zookeeper (3.4.5+dfsg-2) stand-alone, installed from the ...
Greg Dubicki's user avatar
  • 1,321
0 votes
1 answer
6k views

HDFS' ZKFC service unable to start

CDH4's ZooKeeper Failover Controller (ZKFC) has been installed. Starting the ZKFC service: [vagrant@localhost ~]$ sudo service hadoop-hdfs-zkfc start Starting Hadoop zkfc: ...
030's user avatar
  • 6,011
2 votes
2 answers
5k views

Unable to convert HDFS from non-HA to HA

Introduction Aim: Convert HDFS from non-HA to HA. Method: According to this documentation it should be possible to convert HFDS from non- to HA by implementing following configuration: /etc/hadoop/...
030's user avatar
  • 6,011
28 votes
3 answers
61k views

What command could be issued to check whether a ZooKeeper server is a Leader or a Follower?

A ZooKeeper Quorum consisting of three ZooKeeper servers has been created. The zoo.cfg located on all three ZooKeeper servers looks as follows: maxClientCnxns=50 # The number of milliseconds of each ...
030's user avatar
  • 6,011
8 votes
1 answer
13k views

Could not start ZK at requested port of 2181, while export HBASE_MANAGES_ZK=false

Problem The first aim was to run HBase standalone. Navigating to ip:60010/master-status is succesfull once HBase has been started. The second aim is to run a distinct ZooKeeper quorum. ZooKeeper has ...
030's user avatar
  • 6,011
2 votes
2 answers
4k views

How to use nagios to monitor Zookeeper nodes

Sorry this may be a basic question, but I am new to both nagios, and zookeeper. My company has an application that uses zookeeper to track job status, by creating/destroying nodes. I need to be able ...
NSA's user avatar
  • 123
1 vote
1 answer
4k views

Apache Kafka consumer client connecting to Apache Zookeeper: EndOfStreamException

I get an error when trying to 'consume' messages from Kafka (2.9.2-0.8.1) with a Zookeer stand-alone (3.4.5). You can see the source code below as well as the error message and logfile from Zookeeper. ...
sema's user avatar
  • 121
2 votes
2 answers
2k views

Zookeeper starts using bin/zkServer.sh but not with service nor zookeeper-server

On Linux Scientific I have installed ZooKeeper from CDH5. When starting zookeeper using sudo service zookeeper-server start or zookeeper-server start it reports the server running, but fails silently....
Bayes's user avatar
  • 21