Questions tagged [zookeeper]
The zookeeper tag has no usage guidance.
49
questions
0
votes
0
answers
88
views
Apache Kafka Kraft best practices and what is the preferred disk storage for the meta-data topic
My question concerns the recommended disk storage for the topic __cluster_metadata-0 under controllers in Kraft mode.
we have two options:
Locate the topic __cluster_metadata-0 , on OS volume as /...
0
votes
0
answers
40
views
ZooKeeper error ; unrecognized host name for local configuration
I am using Kylin 4+ and want to use Windows and run it locally (without Hadoop).
I follow this tut in their website which states that zookeeper config must be set to local like so:
kylin.env.zookeeper-...
0
votes
0
answers
49
views
How to enable TLSv1.3 on Zookeeper 3.8
I had set the below properties in zoo.cfg to enable TLSv1.3 on zookeper 3.8.0 , but in the logs I see that zookeeper is connected to other zookeeper node on TLSv1.2 that is the default version. I want ...
0
votes
1
answer
99
views
Can I use Zookeeper 3.7.1 with Solr 7.7.3?
Each version of Solr ships with a version of Zookeeper. Solr's docs say that you should upgrade Zookeeper if you upgrade Solr, but can you upgrade Zookeeper to a later version that is shipped with ...
0
votes
0
answers
133
views
What are the risks in running single Zookeeper instance in production?
I'm considering using Zookeeper to manage shared configuration across multiple services that live on a single application server. Usage would be very low volume, mostly reads. My production system ...
1
vote
1
answer
1k
views
zookeeper ssl alert "alert bad certificate"
I am using Kafka (version 2.3.0) and Zookeeper (version 3.5.5-3) - the stable version is 3.6.3.
When I test the SSL of my Zookeeper using this command:
openssl s_client -showcerts -connect 127.0.0.1:...
1
vote
0
answers
635
views
Zookeeper ensemble leader reporting incorrect number of followers
I have a zookeeper ensemble running in Kubernetes consisting of 3 instances. The ensemble operates mostly correctly and successfully services the Solr cluster it is backing. One thing does seem ...
1
vote
0
answers
451
views
How can I further analyze ram usage in a possible leak? [debian@HyperV + Kafka + Zookeeper]
We have a 3-box cluster Kafka+Zookeeper, in a virtualized enviroment (in Windows 2019 HyperV).
In the machines' config dynamic memory is disabled, and they have 4G RAM each (I know it's a very few ...
0
votes
1
answer
1k
views
How set a fixed private IP for ECS containers?
I have a Task Definition called kafka-zookeeper, it has an Apache Kafka broker and a Zookeeper node in it. Those containers need to communicate with each other (that's easy) and with the kafka and ...
16
votes
9
answers
36k
views
Unable to start kafka with zookeeper (kafka.common.InconsistentClusterIdException)
Below the steps I did to get this issue :
Launch ZooKeeper
Launch Kafka : .\bin\windows\kafka-server-start.bat .\config\server.properties
Also note that my OS is Windows
And at the second step ...
0
votes
0
answers
2k
views
zookeeper server due unable to load database on disk
We have kafka cluster with 3 nodes , each kafka include zookeeper server and schema registry
We get the following error on one of the zookeeper server
[2019-11-12 07:44:20,719] ERROR Unable to load ...
0
votes
1
answer
308
views
hadoop + can we install zookeeper servers on kafka hosts
we want to dedicated the zookeeper servers only for kafka machines
so each kafka machine include the zookeeper server
and zookeeper server will serve only the kafka host and not other application
in ...
0
votes
1
answer
245
views
Dose zookeeper servers must use SSD disks?
we want to install kafka cluster and 3 zookeeper servers
kafka should use the zookeeper servers in order to save the metadata on the zookeeper servers
ZK Data and Log files should be on disks, which ...
2
votes
3
answers
9k
views
ZooKeeper not starting because acceptedEpoch is less than the currentEpoch
I have zookeeper.version=3.4.10, and I see:
https://issues.apache.org/jira/browse/ZOOKEEPER-2307
that is however in unresolved status. The problem appeared because of filling up the disk space. Now ...
1
vote
1
answer
383
views
Zookeeper best practice - using only SSD disks
we have HDP clusters version 2.6.0 / 2.6.1 ( hortonworks ) , and maybe in the future the version 3.0
I searched a lot in HORTONWORKS documentation , but not found the details about using SSD disks ...
0
votes
1
answer
5k
views
kafka with ACL fails to connect zk and stops
I have a kafka installation (with ssl listener and ssl client authentication). It works fine until I try to add ACL.
this is the error (full error in the bottom):
[edit-1]
the first error on kafka ...
1
vote
2
answers
5k
views
init script for zookeeper
i have seen that the developers of zookeeper have a great zkServer.sh script to start,stop, restart etc zookeeper, but i have no idea why in the world they decided to skip init script to use.
With ...
4
votes
1
answer
2k
views
Kafka compatible with Zookeeper 3.5 feature 'Rebalancing Client Connections'
In this document https://zookeeper.apache.org/doc/trunk/zookeeperReconfig.html dynamic configuration functionality is described for Zookeeper 3.5.
There are 2 important points in this document:
...
2
votes
0
answers
2k
views
kafka docker - ERROR when sending a message
I would like to implement kafka in a docker container. I use the official zookeper instance for kafka as docker container, too.
When I want to write a message about the terminal, on my linux mint 18....
0
votes
1
answer
3k
views
How to manage failover in ZooKeeper across datacenters using observers
I have an application running in 3 different datacenters that uses ZooKeeper for many tasks. Following the recommended practices, we have deployed three ZooKeeper ensembles where one datacenter ...
2
votes
0
answers
102
views
How to make ActiveMQ nodes keep their database synchronized?
I have 3 servers with Zookeeper and ActiveMQ installed.
Everything seems to be working fine, however, when one of my node dies, and a new election occurs, however the new leader don't have the same ...
5
votes
1
answer
3k
views
Why would using MongoDB in lieu of etcd as a key value store be a good or bad idea? [closed]
I'd like to get general thoughts from the community as to why MongoDB for key/value would OR would not be a suitable replacement for etcd or other purpose-built key/value store system (consol, ...
15
votes
1
answer
45k
views
Get zookeeper cluster status
Is there a cli or some command-line, that I can use to find the zookeeper cluster status. Basically I want to know how to member in cluster or which nodes is acting as a leader.
Any pointers will be ...
2
votes
1
answer
973
views
Port out of range in ReplicatedDB ActiveMQ
I have 3 replicated machines with Zookeeper and ActiveMQ (linux).
I can confirm that zookeeper works correctly since I can see their ports (2888 and 3888) listening via netstat. The problem is ...
0
votes
1
answer
832
views
Why does DFSZKFailoverController kills Namenode process in hadoop?
I try to configure hadoop high availability cluster by following this tutorial:
http://www.edureka.co/blog/how-to-set-up-hadoop-cluster-with-hdfs-high-availability/
When I follow that article I faces ...
2
votes
0
answers
321
views
Restoring Solr Cloud 4.7 index
I have a test environment which is created every morning and then destroyed every night. Part of the environment is a SolrCloud (version 4.7) instance connected to a remote Zookeeper cluster.
The ...
4
votes
0
answers
144
views
Kafka using a distant Zookeeper instance?
we have an existing Zookeeper instance, and want to build a Kafka cluster in a remote location (not on the same side of the Atlantic ocean).
Can we use that existing Zookeeper for our new Kafka usage ...
1
vote
1
answer
995
views
Zookeeper - faulty cluster member replacement
I am aware that as long as there is quorum my zookeeper ensemble will keep working. But does the missing server have any notable impact on the cluster performance?
Let's suppose 1 of 3 servers ...
2
votes
2
answers
7k
views
Solrcloud: Error 500 after restart
I have 3 vm windows, on all of them is installed solr 5.4.0 and 3.4.6 zookeeper; the two services start automatically when the vm start. After reboot vms the solr does not respond correctly, it gives ...
1
vote
1
answer
50
views
Issuing a single command from a cluster of servers?
I have a cluster of servers that will be running a simple ruok command with fallover. The command will be something simple like curl -X POST http://foo.com/status. Due to the fact that I will have ...
1
vote
1
answer
3k
views
How to upgrade zookeeper from 3.4.5 to 3.4.6 on Ubuntu 14.04.3
I am having trouble with a zookeeper ensamble where one node is not able to join the quorum. Zookeeper will not join the cluster. How to apply patch/upgrade? This seems to be related to a bug which ...
0
votes
1
answer
3k
views
Zookeeper will not join the cluster. How to apply patch/upgrade?
I am running a 3 node zookeeper ensemble on ubuntu 14.04. After noticing that node1 was not running, I had to remove the snapshots of this node and now the server did start, but refuses to join the ...
3
votes
1
answer
4k
views
Zookeeper node is not able to load database on production server anymore
I am running a zookeeper ensemble of 3 on three different ubuntu 14.04 nodes. The setup used to work OK, but now I noticed the zk1 is not operational. It does also not restart:
:/home/www$ sudo /etc/...
1
vote
0
answers
630
views
Unable to create index on solr, when using Zookeeper
Evening,
I've created a what I believe to be a simple SOLR cluster, with Zookeeper (external binaries instead of the embeded). For simplicity, this cluster is:
Master: SOLR1
Slave: SOLR2
Both ...
1
vote
1
answer
2k
views
Gracefully take down a Zookeeper Node
I have had a hard disk begin to fail on one of my Zookeeper nodes in a cluster of 3 nodes. It is only a matter of time until the disk dies completely. Rather than waiting for this, I'd like to remove ...
1
vote
1
answer
61
views
Define marathon services listening interface
I have a mesos install with 3 VPS.
I use a virtual private network for internal networking.
Everytime marathon starts and bind a service to a new port, it binds it to 0.0.0.0.
No matter if I had a ...
1
vote
1
answer
491
views
How to maintain zookeeper ensemble?
I have a 3 node zookeeper ensemble running from where I had trouble with one node showing a corrupt db. Now I found in the docs that it has to be cleared regularily with the help of cron running this ...
0
votes
2
answers
3k
views
How to add second ZooKeeper to same machine?
I am running 2 dedicated servers on which I plan to install Solrcloud. I have installed ZooKeeper using apt-get install zookeeperd and ZooKeeper is running on both systems.
From solr docs I learned ...
6
votes
4
answers
44k
views
How can I stop ZooKeeper on Ubuntu?
I have installed zookeeperd on Ubuntu 14.04 (Trusty Tahr) as suggested here:
Unfortunately this process is somehow not stoppable. I tried even kill -9
user@node1:/opt/zookeeper-3.4.6$ ps -ef | ...
0
votes
1
answer
294
views
Why does Accumulo require $ZOOKEEPER_HOME in addition to the IPs of the Zookeeper ensemble?
According to the documentation, Accumulo requires you to set $ZOOKEEPER_HOME (a local path) in the configuration files, and also requires a list of IPs for the Zookeeper ensemble. Why are IPs alone ...
1
vote
1
answer
2k
views
Error 127 when trying to run Zookeeper through supervisord?
I'm getting (exit status 127; not expected) when I try to run Zookeeper through supervisord, and the errors I'm getting back aren't helpful. Running it as the normal user works just fine:
[ec2-user@...
1
vote
2
answers
2k
views
Apache Kafka 0.8.1.1 clean shutdown not working
I have a:
single instance of Apache Kafka (2.9.2-0.8.1.1) installed from the source, using the default configuration (server.properties etc.),
Zookeeper (3.4.5+dfsg-2) stand-alone, installed from the ...
0
votes
1
answer
6k
views
HDFS' ZKFC service unable to start
CDH4's ZooKeeper Failover Controller (ZKFC) has been installed.
Starting the ZKFC service:
[vagrant@localhost ~]$ sudo service hadoop-hdfs-zkfc start
Starting Hadoop zkfc: ...
2
votes
2
answers
5k
views
Unable to convert HDFS from non-HA to HA
Introduction
Aim: Convert HDFS from non-HA to HA.
Method: According to this documentation it should be possible to convert HFDS from non- to HA by implementing following configuration:
/etc/hadoop/...
28
votes
3
answers
61k
views
What command could be issued to check whether a ZooKeeper server is a Leader or a Follower?
A ZooKeeper Quorum consisting of three ZooKeeper servers has been created.
The zoo.cfg located on all three ZooKeeper servers looks as follows:
maxClientCnxns=50
# The number of milliseconds of each ...
8
votes
1
answer
13k
views
Could not start ZK at requested port of 2181, while export HBASE_MANAGES_ZK=false
Problem
The first aim was to run HBase standalone. Navigating to ip:60010/master-status is succesfull once HBase has been started.
The second aim is to run a distinct ZooKeeper quorum. ZooKeeper has ...
2
votes
2
answers
4k
views
How to use nagios to monitor Zookeeper nodes
Sorry this may be a basic question, but I am new to both nagios, and zookeeper.
My company has an application that uses zookeeper to track job status, by creating/destroying nodes. I need to be able ...
1
vote
1
answer
4k
views
Apache Kafka consumer client connecting to Apache Zookeeper: EndOfStreamException
I get an error when trying to 'consume' messages from Kafka (2.9.2-0.8.1) with a Zookeer stand-alone (3.4.5). You can see the source code below as well as the error message and logfile from Zookeeper. ...
2
votes
2
answers
2k
views
Zookeeper starts using bin/zkServer.sh but not with service nor zookeeper-server
On Linux Scientific I have installed ZooKeeper from CDH5.
When starting zookeeper using sudo service zookeeper-server start or zookeeper-server start it reports the server running, but fails silently....