Airflow tasks get stuck at “queued” status and never gets running

后端 未结 4 1422
独厮守ぢ
独厮守ぢ 2020-12-16 11:23

I\'m using Airflow v1.8.1 and run all components (worker, web, flower, scheduler) on kubernetes & Docker. I use Celery Executor with Redis and my tasks are looks like:

4条回答
  •  难免孤独
    2020-12-16 11:59

    We have a solution and want to share it here before 1.9 becomes official. Thanks for Bolke de Bruin updates on 1.9. in my situation before 1.9, currently we are using 1.8.1 is to have another DAG running to clear the task in queue state if it stays there for over 30 mins.

提交回复
热议问题