apache-storm

For some reason I get the following error when I try to run my topology on a Storm cluster: java.lang.NoClassDefFoundError: Could not initialize class org.apache.log4j.Log4jLoggerFactory at org.apache.log4j.Logger.getLogger(Logger.java:39) at kafka.utils.Logging$class.logger(Logging.scala:24) at kafka.consumer.SimpleConsumer.logger$lzycompute(SimpleConsumer.scala:30) at kafka.consumer.SimpleConsumer.logger(SimpleConsumer.scala:30) at kafka.utils.Logging$class.info(Logging.scala:67) at kafka.consumer.SimpleConsumer.info(SimpleConsumer.scala:30) at kafka.consumer.SimpleConsumer.liftedTree1$1

I am running the storm starter project ( https://github.com/nathanmarz/storm-starter ) and it throws the following error after running for a little while. 23135 [main] ERROR org.apache.zookeeper.server.NIOServerCnxn - Thread Thread[main,5,main] died java.io.IOException: Unable to delete file: C:\Users\[user directory]\AppData\Local\Temp\a0894222-6a8a-4f80-8655-3ad6a0c10021\version-2\log.1 at org.apache.commons.io.FileUtils.forceDelete(FileUtils.java:1390) at org.apache.commons.io.FileUtils.cleanDirectory(FileUtils.java:1044) at org.apache.commons.io.FileUtils.deleteDirectory(FileUtils.java:977

We’re using Storm with the Kafka Spout. When we fail messages, we’d like to replay them, but in some cases bad data or code errors will cause messages to always fail a Bolt, so we’ll get into an infinite replay cycle. Obviously we’re fixing errors when we find them, but would like our topology to be generally fault tolerant. How can we ack() a tuple after it’s been replayed more than N times? Looking through the code for the Kafka Spout, I see that it was designed to retry with an exponential backoff timer and the comments on the PR state: "The spout does not terminate the retry cycle (it is

Using the following Q&A I managed to get debugging enabled through eclipse on an Apache Storm cluster (running locally). How to debug Apache Storm in Eclipse? My conf/storm.yaml has the following line to enable debugging on the worker nodes: worker.childopts: "-agentlib:jdwp=transport=dt_socket,address=8000,server=y,suspend=y" When I submit a Topology to storm to run (in a cluster), I can set breakpoints and view variables in my editor. But when I try to run it locally (In Local Mode ), I can't seem to connect (Connection Refused) - through eclipse. # I'm using storm crawler, I submit a

I'm using JSoup in my project and I've declared the dependency in my POM file. It compiles just fine and runs fine too, but only when I used the jar with all dependencies and change the have the scope of the dependency to compiled . If I change this scope to provided , then I can still compile just fine, but not run it. It gives me the ClassNotFoundException . I have included the necessary JAR file in the classpath and also the path variables but I'm still facing this problem. I can get working with the compile option but it's really irking me at the back of my mind why I can't get it running