I am using Celery with RabbitMQ. Lately, I have noticed that a large number of temporary queues are getting made.
So, I experimented and found that when a task fails
amqp backend creates a new queue for each task. If you want to avoid it, you can use rpc backend which keeps results in a single queue.
amqp
rpc
In your config, set
CELERY_RESULT_BACKEND = 'rpc' CELERY_RESULT_PERSISTENT = True
You can read more about this on celery docs.