Celery Redis ConnectionError('max number of clients reached',)

一世执手 提交于 2020-06-28 04:04:31

问题


I have a django application leveraging celery for asynchronous tasks. I've been running into an issue where I reach the max number of redis connections. I am fairly new to both celery and redis.

I'm confused because in my config I define - CELERY_REDIS_MAX_CONNECTIONS = 20 which is the limit on my redis plan.

For experimentation, I bumped the plan up and that solved the issue. I am confused, however, that I am running into this problem again after defining the max number of connections. I downgraded the plan and set the limit to the plans max.

I am wondering if the BROKER_POOL_LIMIT needs to be changed.

Is there anything I am missing to help solve connection errors and celery.

Is it possible to figure out how many connections all of my tasks need? I have 16 jobs running every minute.

Another thought, I noticed that connecting the redis cli threw the connection error, is it possible that I am at the limit, and accessing the cli is putting me over?

I also cant kill connections because I cannot connect to the redis cli while it throws this error.

来源:https://stackoverflow.com/questions/61860262/celery-redis-connectionerrormax-number-of-clients-reached

易学教程内所有资源均来自网络或用户发布的内容,如有违反法律规定的内容欢迎反馈
该文章没有解决你所遇到的问题?点击提问,说说你的问题,让更多的人一起探讨吧!