apache-storm

问题 I'm getting the following error trying so start storm nimbus for a local dev Windows 7 workstation: Error: Could not find or load main class Files\Java\jdk1.8.0_92\bin;C:\Program storm.yaml: storm.zookeeper.servers: - "127.0.0.1" nimbus.seeds: ["127.0.0.1"] storm.local.dir: "C:\\Users\\userX\\Apps\\ApacheStorm\\apache-storm-1.0.1\\data" supervisor.slots.ports: - 6700 - 6701 - 6702 - 6703 I successfully started ZooKeeper. But when I try to run: storm nimbus from the Storm bin folder I get the

问题 I'm getting the following error trying so start storm nimbus for a local dev Windows 7 workstation: Error: Could not find or load main class Files\Java\jdk1.8.0_92\bin;C:\Program storm.yaml: storm.zookeeper.servers: - "127.0.0.1" nimbus.seeds: ["127.0.0.1"] storm.local.dir: "C:\\Users\\userX\\Apps\\ApacheStorm\\apache-storm-1.0.1\\data" supervisor.slots.ports: - 6700 - 6701 - 6702 - 6703 I successfully started ZooKeeper. But when I try to run: storm nimbus from the Storm bin folder I get the

问题 I would like to be able to write new entries into HBase from a distributed (not local) Storm topology. There exist a few GitHub projects that provide either HBase Mappers or pre-made Storm bolts to write Tuples into HBase. These projects provide instructions for executing their samples on the LocalCluster. The problem that I am running into with both of these projects, and directly accessing the HBase API from the bolt, is that they all require the HBase-site.xml file to be included on the

问题 I got this error when I tried to run topology in local mode with storm using mvn compile exec:java -Dexec.classpathScope=compile -Dexec.mainClass=my.Topology the error is ERROR backtype.storm.util - Async loop died! java.lang.OutOfMemoryError: Physical memory usage is too high: physicalBytes = 3G > maxPhysicalBytes = 3G How can I solve it? I don't know which Physical memory I should increase ! and if I run the topology in production mode, will this error be disappeared? UPDATE Physical Memory

问题 Let's say that I have 2 spouts and 3 bolts in Storm cluster and there are two worker nodes. Will be these spouts and bolts shared among these workers (for example first worker has 1 spout and 2 bolts, the second has 1 spout and 1 bolt) or each worker has 2 spouts and 3 bolts which ends up with 4 spouts and 6 bolts in whole cluster? 回答1: Spout and bolt are shared by all your cluster (so worker). If you have 2 spouts and 3 bolts for 2 workers, they will be balanced between your 2 workers. You

问题 I am new to Apache Storm, and I am trying to figure for myself about configuring storm parallelism. So there is a great article "Understanding the Parallelism of a Storm Topology", but it only arouses questions. When you have a multinode storm cluster each topology is distributed as a whole according to TOPOLOGY_WORKERS configuration parameter. So if you have 5 workers, then you have 5 copies of spout (1 per worker), and the same thing is with bolts. How to deal with situation like this

问题 I'm beginner of storm and intellij idea,when I import storm-starter(apache-storm-0.9.5.zip) to intellij idea(14 CE OS),everything is OK,but when I run the "ExclamationTopology" ,a problem appears as follow: Exception in thread "main" java.lang.NoClassDefFoundError: backtype/storm/topology/IRichSpout at java.lang.Class.forName0(Native Method) at java.lang.Class.forName(Class.java:264) at com.intellij.rt.execution.application.AppMain.main(AppMain.java:122) Caused by: java.lang

问题 Does Storm support dynamic topology? The functionality I want from this is to dynamically change the topology according to the user requirement while the Storm topology is running. For example, when user want to know the top-10 words of a stream, I use the top-10 bolt to process it, when user want to know something else, I use the other bolt to process the stream and 'unplug' the top-10 bolt. I know it could be done by partition the stream or duplicate the stream and alway running every

问题 I'm following http://jayatiatblogs.blogspot.com/2011/11/storm-installation.html & http://zookeeper.apache.org/doc/r3.3.3/zookeeperAdmin.html#sc_zkMulitServerSetup to set up Apache Storm cluster in Ubuntu 14.04 LTS at AWS EC2. My master node is 10.0.0.185. My slave nodes are 10.0.0.79, 10.0.0.124 & 10.0.0.84 with myid of 1, 2 and 3 in their zookeeper-data respectively. I set up an ensemble of Apache Zookeeper consists of all the 3 slave nodes. Below are my zoo.cfg for my slave nodes: tickTime

问题 When following the guide in the storm-starter repo, I'm unable to actually run any topology- like the ExclamationTopology . mvn clean install -DskipTests=true ran successfully, executed from the top level Storm repo, as did mvn package at the storm-examples level. When I try to run storm jar target/storm-starter-2.0.0-SNAPSHOT.jar org.apache.storm.starter.ExclamationTopology , I get the error: Error: A JNI error has occurred, please check your installation and try again Exception in thread