apache-zookeeper

问题 I use hadoop2.7.3,Hbase 1.2.3, zookeeper 3.4.9. Each time I stop the Hbase and restart it,it will throw the exception: [hadoop01:16000.activeMasterManager] zookeeper.MetaTableLocator: Failed verification of hbase:meta,,1 at address=hadoop05,16020,1478663588885, exception=org.apache.hadoop.hbase.NotServingRegionException: Region hbase:meta,,1 is not online on hadoop05,16020,1478664215143 at org.apache.hadoop.hbase.regionserver.HRegionServer.getRegionByEncodedName(HRegionServer.java:2922) at

问题 I'm running Kafka (0.10.0.0) in a Docker on a Mac (w/docker-machine). I derived my Dockerfile from Spotify's, which means Kafka and Zookeeper run in the same image. My instance starts cleanly and poking around inside it appears everything is normal/OK. Docker maps ports 2181 and 9092 to high-ports 32822 and 32820 in this case. From outside my running Kafka Docker I am able to successfully telnet 192.168.99.100 32822 (where 192.168.99.100 is the IP of my docker-machine). From there I can issue

问题 I am writing a clustered application sitting on top of Kafka -- it uses Kafka exclusively for interprocess communications and coordination. I could use Zookeeper to manage my cluster -- but it would not be very difficult to use Kafka topics to manage the cluster. And the more I think about it, other than for historical reasons, it seems like Kafka could drop Zookeeper and just use a topic-based solution For example, there could be a special topic or topics in Kafka where you publish all of

问题 i have installed Hive, but when i write command to create table "CREATE TABLE foo(id int, msg STRING);". I throws Exception "Cleanup action completed FAILED: Error in metadata: javax.jdo.JDOFatalDataStoreException: Failed to create database 'metastore_db', see the next exception for details.NestedThrowables:java.sql.SQLException: Failed to create database 'metastore_db', see the next exception for details.FAILED: Execution Error, return code 1 from org.apache.hadoop.hive.ql.exec.DDLTask". Why

问题 I have a situation where I need to insert records into a particular Hive table. One of the columns requires to be an auto-incremented sequence number (that has to strictly follow [max.value + 1] rule at any point of time ). Records are inserted into this particular table from many parallel Hive jobs, that are run in batches - daily, weekly, monthly. Now, I have these questions: Will org.apache.hadoop.hive.contrib.udf.UDFRowSequence ( http://svn.apache.org/repos/asf/hive/trunk/contrib/src/java

问题 we experienced an annoying Kafka consumer problem after a failure in consumer rebalancing. It seems we had network issues at a given time which caused a ZK session expiration. This triggered a re-registration of the consumers and then a rebalancing. The rebalancing failed after 4 tries (rebalance.retries.max=4). On the consumer client sides (Java Kafka Consumers), we did not receive any notification of the pb. We were just not getting any new message, and the clients were running several

问题 I´m using zookeeper 3.4.8 in single node and try to use kafka. When I run this command: zookeeper-server-start.sh /usr/local/kafka_2.9.2-0.8.2.2 /config/zookeeper.properties I get the below error: [2016-02-22 17:32:41,661] ERROR Unexpected exception, exiting abnormally (org.apache.zookeeper.server.ZooKeeperServerMain) java.io.IOException: Unable to create data directory /var/zookeeper/version-2 at org.apache.zookeeper.server.persistence.FileTxnSnapLog.<init>(FileTxnSnapLog.java:85) at org

问题 Currently I have a zookeeper instance controlling replication on 3 servers. It is the solr integrated zookeeper. It works well in my web based application. I have a new requirement which will require sharding in the cloud and I am not sure how to implement it. Basically I want to separate the data which can only be updated by me, shard 1, from the data that users can update, shard 2. From time to time I will be completely replacing the data directory in shard 1 - but I don't want to disturb

问题 Use case: 100 Servers in a pool; I want to start a ZooKeeper service on each Server and Server applications (ZooKeeper client) will use the ZooKeeper cluster (read/write). Then there is no single point of failure. Is this solution possible for this use case? What about the performance? What if there are 1000 Servers in the pool? 回答1: If you are simply trying to avoid a single point of failure, then you only need 3 servers. In a 3 node ensemble, a single failure can be tolerated with the

问题 I need to run Kafka in a local Kubernetes instance (using Minikube) and to have the resulting Kafka service accessible to client applications (publishers and subscribers) outside the Minikube VM. I have everything up and running in Minikube but I suppose that I have made a configuration mistake since I cannot access Kafka from outside. I have read similar questions and tried there suggested solutions but none of them solved the issue for me. I have posted my YAML configuration files at https: