apache-storm

I have two Kafka Spouts whose values I want to send to the same bolt. Is it possible ? Yes it is possible: TopologyBuilder b = new TopologyBuilder(); b.setSpout("topic_1", new KafkaSpout(...)); b.setSpout("topic_2", new KafkaSpout(...)); b.setBolt("bolt", new MyBolt(...)).shuffleGrouping("topic_1").shuffleGrouping("topic_2"); You can use any other grouping, too. Update: In order to distinguish tuples (ie, topic_1 or topic_2) in consumer bolt, there are two possibilities: 1) You can use operator IDs (as suggested by @user-4870385): if(input.getSourceComponent().equalsIgnoreCase("topic_1")) { /

I've dockerized graphite and am working with this library to get metrics from an Apache Storm topology. I'm getting metrics data, but no matter what I do I can only get data per minute where I really need the points to be per second. As per this SO post I've set the retention policy to grab data every second. I've also set conf.put("topology.builtin.metrics.bucket.size.secs", 1); and void initMetrics(TopologyContext context) { messageCountMetric = new CountMetric(); context.registerMetric("digest_count", messageCountMetric, 1); } in the class that's setting up the topology and the bolt itself,

I need to write a storm spout for reading data from a port. Wanted to know if that was logically possible. With that in mind, I had designed a simple topology designed for the same with one spout and one bolt. The spout would gather HTTP requests sent using wget and the bolt would display the request-Just that. My spout structure is as follows: public class ProxySpout extends BaseRichSpout{ //The O/P collector SpoutOutputCollector sc; //The socket Socket clientSocket; //The server socket ServerSocket sc; public ProxySpout(int port){ this.sc=new ServerSocket(port); try{ clientSocket=sc.accept()

I am trying to submit a simple word count topology to my local storm cluster. First, i tried using maven and then using storm command line client. I created the JAR file using eclipse. But, it throws main class not found exception. Can anyone tell me what could be the problem? I am attaching the code and exception below. package com.test.newpackage; import com.test.newpackage.WordReader; import backtype.storm.Config; import backtype.storm.LocalCluster; import backtype.storm.topology.TopologyBuilder; import backtype.storm.tuple.Fields; import com.test.newpackage.WordCounter; import com.test