apache-zookeeper

Solr cloud error while creating collection no config file found

ⅰ亾dé卋堺 提交于 2020-01-16 01:15:07
问题 I am using external zookeper for testing I am using on local system steps I followed are as bellow. Step 1. created 3 zookeper server with data containing myid file containing unique numbers 1,2,3 respectively. Step 2. I started all three zookeper server useing command ./zkServer.sh start Step 3. check status of each server 2 showing status as leader and remaining 2 as Mode: follower Step4 : try to run solr cloud example as /opt/solr$bin/solr start -e cloud -z localhost:2181,localhost:2182

In ZooKeeper, is there a way to write a hierarchy atomically without implementing distributed locks yourself?

元气小坏坏 提交于 2020-01-14 12:19:50
问题 let's say I want to write out this tree to zookeeper . a . / \ . b c . / \ . d e some other client could come along and delete node b right after I create it but before I'm able to write node 'd' or 'e'. Is there a way I can write this hierarchy atomically, or possibly lock a certain path? 回答1: You can use the new multi() API It completes all the operations or aborts them all. 回答2: You can coordinate different clients by either electing a leader or maintaining locks You can read a nice

is kafka reliable when used as a message bus in micro services

旧城冷巷雨未停 提交于 2020-01-13 19:15:07
问题 I am using kafka as a message bus for Micro Service architecture, hence multiple services listen on a topic for a message. Therefore, the services are highly dependent on the topic to be live. But, there are many instances where I get leader not available , broker not available and leader= - 1 on the topics. Now, I am not sure if I can rely on the kafka topics, as services get interrupted when there are issues on the topics with cause issues in the platform. Can someone throw some light on

is kafka reliable when used as a message bus in micro services

你离开我真会死。 提交于 2020-01-13 19:14:08
问题 I am using kafka as a message bus for Micro Service architecture, hence multiple services listen on a topic for a message. Therefore, the services are highly dependent on the topic to be live. But, there are many instances where I get leader not available , broker not available and leader= - 1 on the topics. Now, I am not sure if I can rely on the kafka topics, as services get interrupted when there are issues on the topics with cause issues in the platform. Can someone throw some light on

Solrcloud delete collection bug?

依然范特西╮ 提交于 2020-01-13 19:07:05
问题 First,I create a collection called usercollection : http://xxxxx/solr/admin/collections?action=CREATE&name=usercollection&numShards=3&replicationFactor=3&maxShardsPerNode=3 Then I found something wrong, so I delete it. http://xxxx/solr/admin/collections?action=DELETE&name=usercollection At last ,I want to create the collection again. And I found something wrong. `May 16, 2013 8:32:23 PM org.apache.solr.cloud.OverseerCollectionProcessor run INFO: Overseer Collection Processor: Get the message

what does 2n + 1 quorum mean?

旧街凉风 提交于 2020-01-13 10:22:16
问题 I've come across this when describing the Zookeeper configuration for HBase, and I'm unfamiliar with the term. Does the 'N' have anything to do with the number of nodes in my HBase cluster? Or the number of nodes I should use in my Zookeeper cluster? 回答1: 2f+1 refers to the level of reliability/availablility you require, in general it is not related to performance. ZooKeeper ensembles (serving clusters) are made up of one or more servers which "vote" on each change. A majority of the original

Seeing “partition doesn't exist” warnings/failures after kafka using kafka partition re-assignment tool

喜欢而已 提交于 2020-01-13 10:15:10
问题 I am using kafka 0.8.1.1. I have a 3 node kafka cluster with some topics having around 5 partitions. I planned to increase the number of nodes to 5 in cluster and moving some partitions from existing topics to the new brokers. Previous partition state: broker1 : topic1 { partition 0 } broker2 : topic1 { partition 1,2} broker3 : topic1 { partition 3,4} New intended state: broker1 : topic1 { partition 0} broker2 : topic1 { partition 1} broker3 : topic1 { partition 3} broker4 : topic1 {

org.apache.zookeeper.KeeperException$InvalidACLException: KeeperErrorCode = InvalidACL for /f

最后都变了- 提交于 2020-01-13 06:58:24
问题 I am working with zookeeper 3.4.6, I'm using acl in order to authenticate with zookeeper server. I have my own implementation ZooKeeperSupport , it's a support for create, remove and verify znode. I am triying to create a znode using acl , but fail throwning InvalidACLException in this part of the code zooKeeperSupport.create("/f", DATA_F); I'm basing this project to do it zookeeper-acl-sample, but I want to use digest auth because use user and password BasicMockZookeeperSecurity public class

How do i enable remote jmx with port in zookeeper zkServer.cmd

☆樱花仙子☆ 提交于 2020-01-13 04:14:10
问题 Here my zkServer.cmd file : @echo off setlocal call "%~dp0zkEnv.cmd" set ZOOMAIN=org.apache.zookeeper.server.quorum.QuorumPeerMain echo on call %JAVA% "-Dzookeeper.log.dir=%ZOO_LOG_DIR%" "-Dzookeeper.root.logger=%ZOO_LOG4J_PROP%" -cp "%CLASSPATH%" %ZOOMAIN% "%ZOOCFG%" %* endlocal 回答1: First obtain the hostname (or reachable IP eg. lan/public/NAT address): hostname -i # or find ip ip a next add following options to ZOOMAIN (assumed hostname my.remoteconsole.org and desired port 8989) -Dcom.sun

Bootstrap server vs zookeeper in kafka?

妖精的绣舞 提交于 2020-01-12 02:42:23
问题 Why the use of zookeeper in kafka-consumer is deprecated and why it's recommended to use the bootstrap server instead ? what are the advantages of the bootstrap-server? 回答1: Kafka consumer need to commit the offset to kafka and fetch the offset from kafka , since kafka moved the offset storage from zookeeper to kafka brokers, kafka-consumer does not need to directly communicate with zookeeper, so the new kafka consumer does not need to config the zookeeper. But kafka consumer always need to