Hue集成Oozie | 易学教程

5.1．修改hue配置文件hue.ini


[liboozie]

  # The URL where the Oozie service runs on. This is required in order for
  # users to submit jobs. Empty value disables the config check.
  oozie_url=http://node-1:11000/oozie

  # Requires FQDN in oozie_url if enabled
  ## security_enabled=false

  # Location on HDFS where the workflows/coordinator are deployed when submitted.
  remote_deployement_dir=/user/root/oozie_works

[oozie]
  # Location on local FS where the examples are stored.
  # local_data_dir=/export/servers/oozie-4.1.0-cdh5.14.0/examples/apps

  # Location on local FS where the data for the examples is stored.
  # sample_data_dir=/export/servers/oozie-4.1.0-cdh5.14.0/examples/input-data

  # Location on HDFS where the oozie examples and workflows are stored.
  # Parameters are $TIME and $USER, e.g. /user/$USER/hue/workspaces/workflow-$TIME
  # remote_data_dir=/user/root/oozie_works/examples/apps

  # Maximum of Oozie workflows or coodinators to retrieve in one API call.
  oozie_jobs_count=100

  # Use Cron format for defining the frequency of a Coordinator instead of the old frequency number/unit.
  enable_cron_scheduling=true

  # Flag to enable the saved Editor queries to be dragged and dropped into a workflow.
  enable_document_action=true

  # Flag to enable Oozie backend filtering instead of doing it at the page level in Javascript. Requires Oozie 4.3+.
  enable_oozie_backend_filtering=true

  # Flag to enable the Impala action.
  enable_impala_action=true

[filebrowser]
  # Location on local filesystem where the uploaded archives are temporary stored.
  archive_upload_tempdir=/tmp

  # Show Download Button for HDFS file browser.
  show_download_button=true

  # Show Upload Button for HDFS file browser.
  show_upload_button=true

  # Flag to enable the extraction of a uploaded archive in HDFS.
  enable_extract_uploaded_archive=true

5.2．启动hue、oozie

启动hue进程

cd /export/servers/hue-3.9.0-cdh5.14.0

build/env/bin/supervisor

启动oozie进程

cd /export/servers/oozie-4.1.0-cdh5.14.0

bin/oozied.sh start

页面访问hue


http://node001:8888/

5.3．使用hue配置oozie调度
hue提供了页面鼠标拖拽的方式配置oozie调度

5.4．利用hue调度shell脚本

在HDFS上创建一个shell脚本程序文件。

打开工作流调度页面。

5.5．利用hue调度hive脚本

在HDFS上创建一个hive sql脚本程序文件。

打开workflow页面，拖拽hive2图标到指定位置。

5.6．利用hue调度MapReduce程序

利用hue提交MapReduce程序

5.7．利用Hue配置定时调度任务

在hue中，也可以针对workflow配置定时调度任务，具体操作如下：

一定要注意时区的问题，否则调度就出错了。保存之后就可以提交定时任务。

点击进去，可以看到定时任务的详细信息。

来源：CSDN

作者：沙漠一只雕？

链接：https://blog.csdn.net/bbvjx1314/article/details/103519528

标签

hue

Oozie

HDFS