Questions tagged [zookeeper]

The tag has no usage guidance.

Filter by
Sorted by
Tagged with
1
vote
0answers
25 views

How can I further analyze ram usage in a possible leak? [debian@HyperV + Kafka + Zookeeper]

We have a 3-box cluster Kafka+Zookeeper, in a virtualized enviroment (in Windows 2019 HyperV). In the machines' config dynamic memory is disabled, and they have 4G RAM each (I know it's a very few ...
0
votes
0answers
37 views

I would like to find all the consumers for a kafka topic

Normally I used to check list of consumer groups by "kafka-consumer-groups.sh" command on Linux. Now I want to get the result from a Windows machine. I noticed that .bat binaries missing. ...
0
votes
1answer
29 views

How set a fixed private IP for ECS containers?

I have a Task Definition called kafka-zookeeper, it has an Apache Kafka broker and a Zookeeper node in it. Those containers need to communicate with each other (that's easy) and with the kafka and ...
0
votes
0answers
41 views

Dose even number of Kafka brokers affect ensemble operation and leader election

we are little confuse about if is valid or not to use kafka cluster with even numbers the story begin when we build kafka cluster with 6 machines and trying to use the kafka Reassignment partitions ...
1
vote
5answers
8k views

Unable to start kafka with zookeeper (kafka.common.InconsistentClusterIdException)

Below the steps I did to get this issue : Launch ZooKeeper Launch Kafka : .\bin\windows\kafka-server-start.bat .\config\server.properties Also note that my OS is Windows And at the second step ...
0
votes
0answers
212 views

zookeeper server due unable to load database on disk

We have kafka cluster with 3 nodes , each kafka include zookeeper server and schema registry We get the following error on one of the zookeeper server [2019-11-12 07:44:20,719] ERROR Unable to load ...
0
votes
0answers
386 views

Connection to Solr lost : Please check the Solr instance

Hi I have a Solr cloud environment managed by Zookeeper. When I open the Solr console I am getting an error: "Connection to Solr lost.Please check the Solr instance." What can be wrong?How to debug ...
0
votes
0answers
28 views

Can I change kafka retention period dynamically server wide on all topics?

If I want to increase the retention period server wide on all topics, I'll update "log.retention.hours= " parameter in server.properties file. Is it mandatory to restart all the brokers and zookeepers ...
0
votes
0answers
14 views

update kafka broker from 2.11-1.0.0 to 1.01

We have 3 zookeeper & 3 kafka brokers. I just wants to update kafka broker from 2.11-1.0.0 to 1.0.1. What is the procedure to update the version and keep all my topics as is?
0
votes
1answer
52 views

hadoop + can we install zookeeper servers on kafka hosts

we want to dedicated the zookeeper servers only for kafka machines so each kafka machine include the zookeeper server and zookeeper server will serve only the kafka host and not other application in ...
0
votes
1answer
54 views

Dose zookeeper servers must use SSD disks?

we want to install kafka cluster and 3 zookeeper servers kafka should use the zookeeper servers in order to save the metadata on the zookeeper servers ZK Data and Log files should be on disks, which ...
1
vote
2answers
2k views

ZooKeeper not starting because acceptedEpoch is less than the currentEpoch

I have zookeeper.version=3.4.10, and I see: https://issues.apache.org/jira/browse/ZOOKEEPER-2307 that is however in unresolved status. The problem appeared because of filling up the disk space. Now ...
1
vote
1answer
195 views

Zookeeper best practice - using only SSD disks

we have HDP clusters version 2.6.0 / 2.6.1 ( hortonworks ) , and maybe in the future the version 3.0 I searched a lot in HORTONWORKS documentation , but not found the details about using SSD disks ...
0
votes
1answer
2k views

kafka with ACL fails to connect zk and stops

I have a kafka installation (with ssl listener and ssl client authentication). It works fine until I try to add ACL. this is the error (full error in the bottom): [edit-1] the first error on kafka ...
1
vote
2answers
4k views

init script for zookeeper

i have seen that the developers of zookeeper have a great zkServer.sh script to start,stop, restart etc zookeeper, but i have no idea why in the world they decided to skip init script to use. With ...
4
votes
1answer
976 views

Kafka compatible with Zookeeper 3.5 feature 'Rebalancing Client Connections'

In this document https://zookeeper.apache.org/doc/trunk/zookeeperReconfig.html dynamic configuration functionality is described for Zookeeper 3.5. There are 2 important points in this document: ...
2
votes
0answers
1k views

kafka docker - ERROR when sending a message

I would like to implement kafka in a docker container. I use the official zookeper instance for kafka as docker container, too. When I want to write a message about the terminal, on my linux mint 18....
0
votes
1answer
2k views

How to manage failover in ZooKeeper across datacenters using observers

I have an application running in 3 different datacenters that uses ZooKeeper for many tasks. Following the recommended practices, we have deployed three ZooKeeper ensembles where one datacenter ...
2
votes
0answers
86 views

How to make ActiveMQ nodes keep their database synchronized?

I have 3 servers with Zookeeper and ActiveMQ installed. Everything seems to be working fine, however, when one of my node dies, and a new election occurs, however the new leader don't have the same ...
5
votes
1answer
2k views

Why would using MongoDB in lieu of etcd as a key value store be a good or bad idea? [closed]

I'd like to get general thoughts from the community as to why MongoDB for key/value would OR would not be a suitable replacement for etcd or other purpose-built key/value store system (consol, ...
6
votes
1answer
18k views

Get zookeeper cluster status

Is there a cli or some command-line, that I can use to find the zookeeper cluster status. Basically I want to know how to member in cluster or which nodes is acting as a leader. Any pointers will be ...
2
votes
1answer
498 views

Port out of range in ReplicatedDB ActiveMQ

I have 3 replicated machines with Zookeeper and ActiveMQ (linux). I can confirm that zookeeper works correctly since I can see their ports (2888 and 3888) listening via netstat. The problem is ...
0
votes
1answer
608 views

Why does DFSZKFailoverController kills Namenode process in hadoop?

I try to configure hadoop high availability cluster by following this tutorial: http://www.edureka.co/blog/how-to-set-up-hadoop-cluster-with-hdfs-high-availability/ When I follow that article I faces ...
2
votes
0answers
262 views

Restoring Solr Cloud 4.7 index

I have a test environment which is created every morning and then destroyed every night. Part of the environment is a SolrCloud (version 4.7) instance connected to a remote Zookeeper cluster. The ...
4
votes
0answers
135 views

Kafka using a distant Zookeeper instance?

we have an existing Zookeeper instance, and want to build a Kafka cluster in a remote location (not on the same side of the Atlantic ocean). Can we use that existing Zookeeper for our new Kafka usage ...
1
vote
1answer
788 views

Zookeeper - faulty cluster member replacement

I am aware that as long as there is quorum my zookeeper ensemble will keep working. But does the missing server have any notable impact on the cluster performance? Let's suppose 1 of 3 servers ...
2
votes
2answers
6k views

Solrcloud: Error 500 after restart

I have 3 vm windows, on all of them is installed solr 5.4.0 and 3.4.6 zookeeper; the two services start automatically when the vm start. After reboot vms the solr does not respond correctly, it gives ...
1
vote
1answer
43 views

Issuing a single command from a cluster of servers?

I have a cluster of servers that will be running a simple ruok command with fallover. The command will be something simple like curl -X POST http://foo.com/status. Due to the fact that I will have ...
1
vote
1answer
2k views

How to upgrade zookeeper from 3.4.5 to 3.4.6 on Ubuntu 14.04.3

I am having trouble with a zookeeper ensamble where one node is not able to join the quorum. Zookeeper will not join the cluster. How to apply patch/upgrade? This seems to be related to a bug which ...
0
votes
1answer
2k views

Zookeeper will not join the cluster. How to apply patch/upgrade?

I am running a 3 node zookeeper ensemble on ubuntu 14.04. After noticing that node1 was not running, I had to remove the snapshots of this node and now the server did start, but refuses to join the ...
3
votes
1answer
3k views

Zookeeper node is not able to load database on production server anymore

I am running a zookeeper ensemble of 3 on three different ubuntu 14.04 nodes. The setup used to work OK, but now I noticed the zk1 is not operational. It does also not restart: :/home/www$ sudo /etc/...
1
vote
0answers
460 views

Unable to create index on solr, when using Zookeeper

Evening, I've created a what I believe to be a simple SOLR cluster, with Zookeeper (external binaries instead of the embeded). For simplicity, this cluster is: Master: SOLR1 Slave: SOLR2 Both ...
1
vote
1answer
1k views

Gracefully take down a Zookeeper Node

I have had a hard disk begin to fail on one of my Zookeeper nodes in a cluster of 3 nodes. It is only a matter of time until the disk dies completely. Rather than waiting for this, I'd like to remove ...
1
vote
1answer
51 views

Define marathon services listening interface

I have a mesos install with 3 VPS. I use a virtual private network for internal networking. Everytime marathon starts and bind a service to a new port, it binds it to 0.0.0.0. No matter if I had a ...
1
vote
1answer
363 views

How to maintain zookeeper ensemble?

I have a 3 node zookeeper ensemble running from where I had trouble with one node showing a corrupt db. Now I found in the docs that it has to be cleared regularily with the help of cron running this ...
0
votes
2answers
2k views

How to add second ZooKeeper to same machine?

I am running 2 dedicated servers on which I plan to install Solrcloud. I have installed ZooKeeper using apt-get install zookeeperd and ZooKeeper is running on both systems. From solr docs I learned ...
5
votes
4answers
33k views

How can I stop ZooKeeper on Ubuntu?

I have installed zookeeperd on Ubuntu 14.04 (Trusty Tahr) as suggested here: Unfortunately this process is somehow not stoppable. I tried even kill -9 user@node1:/opt/zookeeper-3.4.6$ ps -ef | ...
0
votes
1answer
252 views

Why does Accumulo require $ZOOKEEPER_HOME in addition to the IPs of the Zookeeper ensemble?

According to the documentation, Accumulo requires you to set $ZOOKEEPER_HOME (a local path) in the configuration files, and also requires a list of IPs for the Zookeeper ensemble. Why are IPs alone ...
1
vote
1answer
1k views

Error 127 when trying to run Zookeeper through supervisord?

I'm getting (exit status 127; not expected) when I try to run Zookeeper through supervisord, and the errors I'm getting back aren't helpful. Running it as the normal user works just fine: [ec2-user@...
1
vote
2answers
1k views

Apache Kafka 0.8.1.1 clean shutdown not working

I have a: single instance of Apache Kafka (2.9.2-0.8.1.1) installed from the source, using the default configuration (server.properties etc.), Zookeeper (3.4.5+dfsg-2) stand-alone, installed from the ...
0
votes
1answer
6k views

HDFS' ZKFC service unable to start

CDH4's ZooKeeper Failover Controller (ZKFC) has been installed. Starting the ZKFC service: [vagrant@localhost ~]$ sudo service hadoop-hdfs-zkfc start Starting Hadoop zkfc: ...
2
votes
2answers
4k views

Unable to convert HDFS from non-HA to HA

Introduction Aim: Convert HDFS from non-HA to HA. Method: According to this documentation it should be possible to convert HFDS from non- to HA by implementing following configuration: /etc/hadoop/...
24
votes
2answers
40k views

What command could be issued to check whether a ZooKeeper server is a Leader or a Follower?

A ZooKeeper Quorum consisting of three ZooKeeper servers has been created. The zoo.cfg located on all three ZooKeeper servers looks as follows: maxClientCnxns=50 # The number of milliseconds of each ...
8
votes
1answer
10k views

Could not start ZK at requested port of 2181, while export HBASE_MANAGES_ZK=false

Problem The first aim was to run HBase standalone. Navigating to ip:60010/master-status is succesfull once HBase has been started. The second aim is to run a distinct ZooKeeper quorum. ZooKeeper has ...
2
votes
2answers
4k views

How to use nagios to monitor Zookeeper nodes

Sorry this may be a basic question, but I am new to both nagios, and zookeeper. My company has an application that uses zookeeper to track job status, by creating/destroying nodes. I need to be able ...
1
vote
1answer
4k views

Apache Kafka consumer client connecting to Apache Zookeeper: EndOfStreamException

I get an error when trying to 'consume' messages from Kafka (2.9.2-0.8.1) with a Zookeer stand-alone (3.4.5). You can see the source code below as well as the error message and logfile from Zookeeper. ...
2
votes
2answers
1k views

Zookeeper starts using bin/zkServer.sh but not with service nor zookeeper-server

On Linux Scientific I have installed ZooKeeper from CDH5. When starting zookeeper using sudo service zookeeper-server start or zookeeper-server start it reports the server running, but fails silently....