Oozie + Sqoop: JDBC Driver Jar Location

前端 未结 4 1376
我寻月下人不归
我寻月下人不归 2020-12-17 01:32

I have a 6 node cloudera based hadoop cluster and I\'m trying to connect to an oracle database from a sqoop action in oozie.

I have copied my ojdbc6.jar into the sqo

4条回答
  •  感情败类
    2020-12-17 02:13

    The JDBC driver jar (and any jars it depends on) should go in your Oozie sharelib folder on HDFS. I'm running Hortonworks Data Platform 1.2 instead of Cloudera 4.2 so the details may vary, but my JDBC driver is located in /user/oozie/share/lib/sqoop. This should allow you to run Sqoop with the JDBC via Oozie.

    It is not necessary to put to the JDBC driver jar in the sqoop lib on the data nodes. In my setupt I can't run a simple sqoop eval from the command line on my data nodes. I understand the logic for why you thought this would work. The reason the JDBC driver jar needs to be on HDFS is so that all the data nodes have access to it. Your solution should accomplish the same goal. I'm not familiar enough with the inner workings of Oozie to say why using the sharelib works but your solution does not.

提交回复
热议问题