I am trying to find an equivalent of Celery project for Java environment, I have looked at Spring Batch, but are there any better alternatives for distributed task queues.
Thanks.
What Celery is doing is very much akin to EIP, and SEDA with convenient task scheduling... (all you have left to do is add some DB, and async HTTP networking and you have got a complete enterprise quality stack).
Basically in Java there is the Spring way, the Java EE way, and the Hadoop way:
- Spring: Spring Integration + Spring Batch + RabbitMQ
- Java EE: Mule + Quartz or EJB Scheduling + HornetMQ
- Hadoop: Capacity + ZooKeeper
Those are roughly in order of ease of setting up.
Jesque (https://github.com/gresrun/jesque) is a Java distributed task queue library. It is a Java port of the Resque library (https://github.com/defunkt/resque), which is described like this on its GitHub page:
Resque (pronounced like "rescue") is a Redis-backed library for creating background jobs, placing those jobs on multiple queues, and processing them later."
Quartz has worked for me in the past. It's integrated with Terracotta now, so it should be easy to distribute. http://quartz-scheduler.org/
Celery is primarily based on Erlang/RabbitMQ. RabbitMQ has a Java client library that might be useful. Also, there is octobot which has a RabbitMQ backend.
The closest thing I've found is Octobot: https://github.com/cscotta/Octobot Not so much documentation though... there used to be a website for it at octobot.taco.cat, but I haven't seen that load lately. I haven't personally used Octobot, but I've often seen it recommended as a Celery for Java.
I haven't been able to find anything as easy to use as Celery for Java. Most of the solutions recommended to use a message queue. But Celery sits one level of abstraction higher than the queue. Instead of messages and consumers, you can think in terms of tasks and workers, results, retries etc.
I also needed to implement some bridge for a company using both Java and Python so I started this project:
celery-java - Celery client and worker in Java, compatible with their Python counterparts.
Beware, it's very immature as of now.
Distributed Java tasks scheduling and execution https://redisson.org/
Apache ActiveMQ http://activemq.apache.org/
Apache Kafka http://kafka.apache.org/
来源：https://stackoverflow.com/questions/9577012/whats-the-equivalent-of-pythons-celery-project-for-java