Airflow : Run a task when some upstream is skipped by shortcircuit

后端 未结 5 515
难免孤独
难免孤独 2021-01-17 20:11

I have a task that I\'ll call final that has multiple upstream connections. When one of the upstreams gets skipped by ShortCircuitOperator this tas

5条回答
  •  [愿得一人]
    2021-01-17 20:37

    This may have been added after you asked your initial question, but Airflow now conveniently has a trigger_rule value of none_failed. If you set this on your final task, it should complete whether upstream tasks are skipped or succeeded, just not when they fail.

    More info: https://airflow.apache.org/concepts.html#trigger-rules

提交回复
热议问题