Running Oozie actions in parallel

拜拜、爱过 提交于 2020-01-14 01:12:09

问题


I am using the workflow editor in Hue to develop an Oozie workflow. There are a few action that should be executed in parallel.

Is it possible to execute two or more actions concurrently?
How can I set it up in Hue?


回答1:


Yes, it is possible. Among various Oozie workflow nodes, there are two control nodes fork and join:

A fork node splits one path of execution into multiple concurrent paths of execution.

A join node waits until every concurrent execution path of a previous fork node arrives to it.

The fork and join nodes must be used in pairs. The join node assumes concurrent execution paths are children of the same fork node.

Hue does support it, although it's not very intuitive - you can drag and drop actions on the workflow, but you cannot do the same for the control nodes.

To split one path of execution into two concurrent ones, drag one action onto another (e.g. step_B onto step_A in the example below):

This will add a fork node automatically and place the appropriate action underneath:



来源:https://stackoverflow.com/questions/25988809/running-oozie-actions-in-parallel

标签
易学教程内所有资源均来自网络或用户发布的内容,如有违反法律规定的内容欢迎反馈
该文章没有解决你所遇到的问题?点击提问,说说你的问题,让更多的人一起探讨吧!