apache-storm

I'm using the Python Storm library streamparse (which utilizes pystorm underneath). I've had problems calling a Spouts fail() method in the boilerplate wordcount project. According to the pystorm quickstart docs and numerous things I've read, calling fail(tuple) in a Bolt should elicit a failure in the originating Spout. However, even with the few modifications I've made, I always get a Spout ack() right when it leaves the Spout. Is this the correct behavior, or do I need to change a setting/instance variable? I'm on streamparse 3.4.0 and storm 1.0.2 . My logs show the Spout ack() coming

I am using the kafkaSpout that came with storm-0.9.2 distribution for my project. I want to monitor the throughput of this spout. I tried using the KafkaOffsetMonitoring, but it does not show any consumers reading from my topic. I suspect this is because I have specified the root path in Zookeeper for the spout to store the consumer offsets. How will the kafkaOffsetMonitor know that where to look for data about my kafkaSpout instance? Can someone explain exactly where does zookeeper store data about kafka topics and consumers? The zookeeper is a filesystem. So, how does it arrange data of

Can field grouping be done on tuples emitted by a kafka spout? If yes, then how does Storm gets to know the fields in a Kafka record? Kafka Spout declared its output fields like any other component. My explanation is based on current implementation of KafkaSpout. In KafkaSpout.java class we see declareOutputFields method that call getOutputFields() method of KafkaConfig Scheme. @Override public void declareOutputFields(OutputFieldsDeclarer declarer) { declarer.declare(_spoutConfig.scheme.getOutputFields()); } By default, KafkaConfig uses RawMultiScheme that implements this method in this way.

I am always getting following error: [ERROR] connection attempt 86 to Netty-Client-/202.162.247.10:6731 failed: java.net.ConnectException: Connection refused: /202.162.247.10:6731 Why is this happening? I tried and googled multiple times but found no solution. 来源： https://stackoverflow.com/questions/34648103/storm-error-connection-attempt-86-to-netty-client

I would like to be able to write new entries into HBase from a distributed (not local) Storm topology. There exist a few GitHub projects that provide either HBase Mappers or pre-made Storm bolts to write Tuples into HBase. These projects provide instructions for executing their samples on the LocalCluster. The problem that I am running into with both of these projects, and directly accessing the HBase API from the bolt, is that they all require the HBase-site.xml file to be included on the classpath. With the direct API approach, and perhaps with the GitHub ones as well, when you execute

Is it possible for a bolt receive multiple input tuples from different spout/bolt? For instance, Bolt C receive input tuples from Spout A and input tuples from Bolt B to be processed. How should I implement it? I mean writing the Java code for Bolt C and also its topology. Tutorial answers your question. https://storm.apache.org/documentation/Tutorial.html Here is the code for your goal(C/P from tutorial): builder.setBolt("exclaim2", new ExclamationBolt(), 5) .shuffleGrouping("words") .shuffleGrouping("exclaim1"); exclaim2 will accept tuples from both words and exclaim1 , both using shuffle