apache-storm

问题 Compile no problem, but after run..... 26183 [Thread-34] ERROR backtype.storm.util - Async loop died! java.lang.UnsatisfiedLinkError: org.zeromq.ZMQ$Socket.finalize()V at org.zeromq.ZMQ$Socket.finalize(Native Method) at org.zeromq.ZMQ$Socket.close(ZMQ.java:339) at storm.starter.spout.RandomSentenceSpout.nextTuple(RandomSentenceSpout.java:56) at backtype.storm.daemon.executor$fn__3985$fn__3997$fn__4026.invoke(executor.clj:502) at backtype.storm.util$async_loop$fn__465.invoke(util.clj:377) at

问题 I am trying to run storm starter example in Linux using Eclipse. I am getting following error and nexttuple function is never called. ERROR: 35979 [main] INFO o.a.s.d.supervisor - Shutting down supervisor cfba8fc6- 81e6-47cb-b8b9-ec7c700f4dfe 35981 [NIOServerCxn.Factory:0.0.0.0/0.0.0.0:2000] WARN o.a.s.s.o.a.z.s.NIOServerCnxn - caught end of stream exception org.apache.storm.shade.org.apache.zookeeper.server.ServerCnxn$EndOfStreamException: Unable to read additional data from client sessionid

问题 I have created a simple program to read from file and generate a file.Its working perfectly.I am worrying about how to make it real time topology.I want if i modify source file means added a new record it should come in my target file how i will do it without redeploying my topology on cluster.What else i need to configure to achieve this behavior.Below is code of submitting topology locally:- Config conf= new Config(); conf.setDebug(false); conf.put(Config.TOPOLOGY_MAX_SPOUT_PENDING,1);

问题 I have created a topology which should read from a file and write it to a new file. My program is running properly in local cluster but while submitting in remote cluster i am not getting any error but file is not getting created. below is my code to submit topolgy in remote cluster :- public static void main(String[] args) { final Logger logger = LoggingService.getLogger(FileToFileTopology.class.getName()); try{ Properties prop =new Properties(); prop.load(new FileInputStream(args[0]+"

问题 I am trying to build an RPM based on the latest 0.9.x branch, because the version 0.9.6 contains a critical bug fix but there is no official release for that version. When I build my RPM and run it, I get this message: The storm client can only be run from within a release. You appear to be trying to run the client from a checkout of Storm's source code. You can download a Storm release at http://storm-project.net/downloads.html This blog describes how to build the from source: http://blog

问题 The error i had when submit a topology java.net.ConnectException: Connection refused at backtype.storm.utils.NimbusClient.<init>(NimbusClient.java:36) at backtype.storm.utils.NimbusClient.getConfiguredClient(NimbusClient.java:17) This what i got in nimbus log file 2015-09-22 04:19:58 ClientCnxn [INFO] Socket connection established to localhost/127.0.0.1:2181, initiating session 2015-09-22 04:20:13 ConnectionState [ERROR] Connection timed out org.apache.zookeeper.KeeperException

问题 I have compiled a topology. In nimbus status I have some sequence of numbers like this executor->start-time-secs <[2 2]1389244616,[3 3]1389244616,[4 4]1389244616,[5 5]1389244616, What do the sequence numbers mean? 回答1: In the sequence :executor->start-time-secs <[2 2]1389244616,[3 3]1389244616,[4 4]1389244616,[5 5]1389244616, [2 2],[3 3],[1 1] - represents the node. These node are assigned in :executor->node+port{} as given below which is further used by topology :executor->node+port {[3 3] [

问题 I am unable to run a very basic program of creating a "Hello World" java client of Elastic-Search. The documentation is extremely terse about what to do in such cases. Here is my code: find . -type f ./pom.xml ./src/main/java/examples/EsRoutingNodeClient.java Both files are shown below. Java file containing the code: package examples; import org.elasticsearch.action.index.IndexResponse; import org.elasticsearch.client.Client; import org.elasticsearch.common.settings.Settings; import org

问题 I'm desparately trying to configure serializer instances to use in my storm topology. The storm documentation states, there are 2 ways to register serializers : 1. The name of a class to register. In this case, Storm will use Kryo’s FieldsSerializer to serialize the class. This may or may not be optimal for the class – see the Kryo docs for more details. 2. A map from the name of a class to register to an implementation of com.esotericsoftware.kryo.Serializer. I want to use 2. -> Map<String,

问题 I'm trying to write simple Storm + Camel project. My Storm topology analyzes tweets and one bolt should send tweet text to apache camel route, which in turn is using websocket to notify some webapp. I cannot make it work due to NotSerializableExceptions received from bolts when trying to use build once CamelContext. What I've already tried: pass CamelContext in bolt's constructor - results in NotSerializableException pass CamelContext in storm conf, and use it in bolt's prepare(...) method to