apache-zookeeper

Zookeeper not starting, nohup error

由 ⅰ亾dé卋堺 提交于 2019-12-06 09:01:04
问题 I have Downloaded zookeeper-3.4.5.tar.gz and after extracting it I wrote conf/zoo.cfg as tickTime=2000 dataDir=/var/zookeeper clientPort=2181 Now I tried to start zookeeper by bin/zkServer.sh start it gives mohit@mohit:~/zookeeper-3.4.5/bin$ sudo sh zkServer.sh start [sudo] password for mohit: JMX enabled by default Using config: /home/mohit/zookeeper-3.4.5/bin/../conf/zoo.cfg Starting zookeeper ... STARTED But $ echo ruok | nc localhost 2181 is not giving any output. I checked zookeeper.out,

Zookeeper: Hostname resolution fails

由 左心房为你撑大大i 提交于 2019-12-06 08:20:50
问题 I am running Zookeeper in an OpenShift/Kubernetes environment. I have setup zookeeper as a StatefulSet in order to reliably persist config data. I configured three servers in my zoo.cfg by hostname, but on startup, hostname resolution fails. I verified hostnames are indeed resolvable using nslookup inside my cluster. zoo.cfg: clientPort=2181 dataDir=/var/lib/zookeeper/data dataLogDir=/var/lib/zookeeper/log tickTime=2000 initLimit=10 syncLimit=2000 maxClientCnxns=60 minSessionTimeout= 4000

configure Druid to connect to Zookeeper on port 5181

由 十年热恋 提交于 2019-12-06 07:54:25
I'm running a MapR cluster and want to do some timeseries analysis with Druid . MapR uses a non-standard port for Zookeeper (port 5181 instead of the conventional port 2181). When I start the Druid coordinator service, it attempts to connect on the conventional Zookeeper port and fails: 2015-03-03T17:46:49,614 INFO [main-SendThread(localhost:2181)] org.apache.zookeeper.ClientCnxn - Opening socket connection to server localhost/0:0:0:0:0:0:0:1:2181. 2015-03-03T17:46:49,617 WARN [main-SendThread(localhost:2181)] org.apache.zookeeper.ClientCnxn - Session 0x0 for server null, unexpected error,

How to monitor application processing of Kafka messages for load testing

由 亡梦爱人 提交于 2019-12-06 06:53:33
问题 There is an application (not mine) that reads messages from Kafka, does some processing on them, and stores records in a database. I've put together a program in Java that writes messages into the queue at a given rate. Right now, it does a simple measure of performance by querying the database at the end of the test run to ensure that records in = records out. However, I'd like to expand it to periodically check the queue to see how many messages are pending that the application hasn't yet

HBase on Hortonworks HDP Sandbox: Can't get master address from ZooKeeper

由 女生的网名这么多〃 提交于 2019-12-06 05:13:36
问题 I downloaded HDP 2.1 from hortonworks for virtualbox. I got the following error when using Hbase shell in case simple command: create 't1', {NAME=> 'f1', VERSIONS => 5} Hortonworks “ERROR: Can't get master address from ZooKeeper; znode data == null” What do I need to do to get hbase working in this sandbox environment? 回答1: In hortonwork sandbox you have to manually start hbase. Try to run the following command (as root user), su hbase - -c "/usr/lib/hbase/bin/hbase-daemon.sh --config /etc

Trouble using hbase from java on Amazon EMR

由 眉间皱痕 提交于 2019-12-06 03:49:57
问题 So Im trying to query my hbase cluster on Amazon ec2 using a custom jar i launch as a MapReduce step. Im my jar (inside the map function) I call Hbase as so: public void map( Text key, BytesWritable value, Context contex ) throws IOException, InterruptedException { Configuration conf = HBaseConfiguration.create(); HTable table = new HTable(conf, "tablename"); ... the problem is that when it gets to that HTable line and tries to connect to hbase, the step fails and I get the following errors:

kafka cant connect to zookeeper- FATAL Fatal error during KafkaServerStable startup

由 a 夏天 提交于 2019-12-06 03:48:21
问题 Well..every service in the world can connect to my zookeeper expect kafka. Below is my connection string in server.properties file zk.connect=1.dzk.syd.druid.neo.com:2181, 2.dzk.syd.druid.neo.com:2181 Have have all ports on the two zookeeper servers ....total promiscuous mode. I can even telnet into the zookeeper server from the kafka server.. telnet 2.dzk.syd.druid.neo.com 2181 Trying 54.252.183.218... Connected to 2.dzk.syd.druid.neo.com. Escape character is '^]'. So....rather confused on

Kafka cached zkVersion not equal to that in zookeeper broker not recovering

由 ￣綄美尐妖づ 提交于 2019-12-06 01:34:15
问题 I have a kafka cluster with 3 brokers. I have started facing issues lately with brokers going out of the cluster and producrs/consumers throwing leader not available errors. On examining the logs I see following sequence of events: //Lots of replica fetcher threads starting/stopping [2017-10-09 14:48:50,600] INFO [ReplicaFetcherManager on broker 6] Removed fetcher for partitions [2017-10-09 14:48:50,608] INFO [ReplicaFetcherThread-0-7], Shutting down (kafka.server.ReplicaFetcherThread) [2017

Failing to write offset data to zookeeper in kafka-storm

由 孤街浪徒 提交于 2019-12-05 21:54:46
问题 I was setting up a storm cluster to calculate real time trending and other statistics, however I have some problems introducing the "recovery" feature into this project, by allowing the offset that was last read by the kafka-spout (the source code for kafka-spout comes from https://github.com/apache/incubator-storm/tree/master/external/storm-kafka) to be remembered. I start my kafka-spout in this way: BrokerHosts zkHost = new ZkHosts("localhost:2181"); SpoutConfig kafkaConfig = new

How to programmatically detect which server in ensemble client is connected to?

由 你。 提交于 2019-12-05 20:59:14
How to programmatically detect which server in a ZooKeeper ensemble a client is connected to? I'm using the Apache Curator API and I am listening for state changes in connection by registering ConnectionStateListener . I would like to know which server in the ensemble a client is connected to when the client reconnects if the server it was connected to goes down. You can see this in the logs produced by Curator. In the example output below, the CuratorFramework client has been given 4 different ZooKeeper instances in the connectionString that it can connect to. As can be seen in the log, it
订阅 apache-zookeeper