apache-zookeeper

What's the difference between zookeeper vs spring cloud config server?

∥☆過路亽.° 提交于 2019-12-03 10:54:16
What's the difference between zookeeper vs spring cloud config server? They both store configurations in server and make them available to clients. When should one be used over the other? What's the difference between zookeeper vs spring cloud config server? With the Spring Cloud Config Server you have a central place to manage external properties for applications across all environments. The concepts on config server map identically to the Spring Environment and PropertySource abstractions, so they fit very well with Spring applications , but can be used with any application running in any

Is there any way to configure nginx (or other quick reverse proxy) dynamically?

会有一股神秘感。 提交于 2019-12-03 08:39:56
问题 Suppose we have several identical nodes which are the application servers of some n-tier service. And suppose we use Apache ZooKeeper to keep all the config's of our distributed application. Plus we have an nginx as a load balancer and reverse proxy in front of this application. So let's say we perform a command which changes data only on node1, and for some period of time node2 differs from node1. And we want proxy to redirect all that special requests (which need that specific data) to

Most efficient way to create a path in zookeeper where root elements of the path may or may not exist?

自闭症网瘾萝莉.ら 提交于 2019-12-03 07:09:53
Imagine a path "/root/child1/child2/child3" Imagine in zookeeper that maybe a part of this exists, say "/root/child1" There is no equivalent of "mkdir -p" in zookeeper; Also, ZooKeeper.multi() will fail if any one operation fails, so a "make path" couldn't really be baked into a multi call. Additionally, you could have some other client trying to make the same path... This is what I have come up with for creating a path. I wonder if it is even worth checking to see if a part exists or not, to save the round trip of the exists() call. //String[] pathParts new String[] { "root", "child1",

Kafka in Kubernetes - Marking the coordinator dead for group

和自甴很熟 提交于 2019-12-03 06:34:48
I am pretty new to Kubernetes and wanted to setup Kafka and zookeeper with it. I was able to setup Apache Kafka and Zookeeper in Kubernetes using StatefulSets. I followed this and this to build my manifest file. I made 1 replica of kafka and zookeeper each and also used persistent volumes. All pods are running and ready. I tried to expose kafka and used Service for this by specifying a nodePort(30010). Seemingly this would expose kafka to the outside world where they can send messages to the kafka broker and also consume from it. But in my Java application, I made a consumer and added the

Got user-level KeeperException when processing

北城余情 提交于 2019-12-03 04:53:47
I know this has been asked before , so please forgive me for asking again, but none of the solutions pointed to by that thread worked for me. I'm trying to setup Kafka 0.10.20 following the docs. When I start ZooKeeper, I get the following logs: $ bin/zookeeper-server-start.sh config/zookeeper.properties [2017-04-22 12:25:15,810] INFO Reading configuration from: config/zookeeper.properties (org.apache.zookeeper.server.quorum.QuorumPeerConfig) [2017-04-22 12:25:15,814] INFO autopurge.snapRetainCount set to 3 (org.apache.zookeeper.server.DatadirCleanupManager) [2017-04-22 12:25:15,815] INFO

How to point autoconf/automake to non-standard packages

一个人想着一个人 提交于 2019-12-03 03:20:46
I'm trying to build ZooKeeper on a RedHat Linux box. (Exactly what ZooKeeper is is probably not important :-) When I follow the package instructions, I get: $ autoreconf -if aclocal:configure.ac:33: warning: macro `AM_PATH_CPPUNIT' not found in library aclocal:configure.ac:33: warning: macro `AM_PATH_CPPUNIT' not found in library configure.ac:33: error: possibly undefined macro: AM_PATH_CPPUNIT If this token and others are legitimate, please use m4_pattern_allow. See the Autoconf documentation. autoreconf: /usr/bin/autoconf failed with exit status: 1 I can't install CPPPUNIT in the standard

ZooKeeper for Java/Spring Config?

不想你离开。 提交于 2019-12-03 02:48:27
问题 Are there any well documented use cases of Apache ZooKeeper being used to distribute configuration of Java applications, and in particular Spring services? Like many users of cloud services I have a requirement to change the configuration of a variable amount of Java services, preferably at run-time without needing to restart the services. UPDATE Eventually I ended up writing something that would load a ZooKeeper node as a properties file, and create a ResourcePropertySource and insert it

List all kafka topics

心不动则不痛 提交于 2019-12-03 00:55:50
I'm using kafka 0.10 without zookeeper . I want to get kafka topics list. This command is not working since we're not using zookeeper: bin/kafka-topics.sh --list --zookeeper localhost:2181 . How can I get the same output without zookeeper? Kafka uses ZooKeeper so you need to first start a ZooKeeper server if you don't already have one. If you do not want to install and have a separate zookeeper server, you can use the convenience script packaged with kafka to get a quick-and-dirty single-node ZooKeeper instance. Starting the single-node Zookeeper instance: bin/zookeeper-server-start.sh config

Real World Use of Zookeeper [closed]

瘦欲@ 提交于 2019-12-03 00:02:35
问题 Closed . This question is opinion-based. It is not currently accepting answers. Want to improve this question? Update the question so it can be answered with facts and citations by editing this post. Closed 3 years ago . This post is a Community Wiki . Edit existing answers to improve this post. It is not currently accepting new answers. I've been looking at Zookeeper recently and wondered whether anybody was using it currently and what they were specifically using it for storing. The most

Is there any way to configure nginx (or other quick reverse proxy) dynamically?

好久不见. 提交于 2019-12-02 22:28:30
Suppose we have several identical nodes which are the application servers of some n-tier service. And suppose we use Apache ZooKeeper to keep all the config's of our distributed application. Plus we have an nginx as a load balancer and reverse proxy in front of this application. So let's say we perform a command which changes data only on node1, and for some period of time node2 differs from node1. And we want proxy to redirect all that special requests (which need that specific data) to node1 until all the infomation has migrated to node2 and node2 has the same data as node1. Is there any way