celery

I'm writing a Django app that uses celery. So far I've been running on Ubuntu, but I'm trying to deploy to CentOS. Celery comes with a nice init.d script for Debian-based distributions, but it doesn't work on RedHat-based distributions like CentOS because it uses start-stop-daemon. Does anybody have an equivalent one for RedHat that uses the same variable conventions so I can reuse my /etc/default/celeryd file? Camilo Nova Is better solved here: Celery CentOS init script You should be good using that one Since I didn't get an answer, I tried to roll my own: #!/bin/sh # # chkconfig: 345 99 15 #

I'm running Celery under Docker Compose. I'd like to make Celery's Flower persistent. So I do: version: '2' volumes: [...] flower_data: {} [...] flower: image: [base code image] ports: - "5555:5555" volumes: - flower_data:/flower command: celery -A proj flower --port=5555 --persistent=True --db=/flower/flower However, then I get: IOError: [Errno 13] Permission denied: 'flower.dat' I ran the following to elucidate why: bash -c "ls -al /flower; whoami; celery -A proj flower --persistent=True --db=/flower/flower" This made it clear why: flower_1 | drwxr-xr-x 3 root root 4096 Mar 10 23:05 . flower

I have a two tasks - a and b . Task a running in 5 minutes after finish previous task a . Task b running in 3 minutes after finish previous task b . How can I implement it? I'm use python 3.6.8 , Django 2.2.6 and celery 4.3.0 ? The short answer is that you can't do this with celery beat because celery beat will trigger off of task start and not at task end. If you absolutely need to do it three minutes after the previous task ends, you'd be advised to just adding a call to .apply_async at the end of both a and b and kicking off each task once. 来源： https://stackoverflow.com/questions/58629790

I currently use a C extension library for Python, but it seems to have memory leaks. Tasks that are run on my celeryd do something using this C extension library, and celeryd eats a lot of memory about a hour later. I cannot patch this C extension library in many reasons, but instead I want to fork processes for every task in Celery. Are there any such options for Celery? mher You can use CELERYD_MAX_TASKS_PER_CHILD option or --maxtasksperchild celeryd switch. To restart worker processes after every task: CELERYD_MAX_TASKS_PER_CHILD=1 https://celery.readthedocs.org/en/latest/userguide/workers