Launch a subdag with variable parallel tasks in airflow
问题 I have an airflow workflow that I'd like to modify (see illustration at the bottom). However, I couldn't find a way to do that in the docs. I've looked at subdags, branching and xcoms without luck. There doesn't seem to be a way to specify how many tasks should run in parallel in a subdag based on a return from an operator. To add to the problem, each task in the subdag receives a different parameter (an element from the list returned by the previous operator) This is an illustration of what