Sqoop - Binding to YARN queues

此生再无相见时 提交于 2019-12-22 05:29:07

问题


So with mapreduce v2 you can use binding to certain YARN queues to manage resources and prioritization. Basically by using

"hadoop jar /xyz.jar -D mapreduce.job.queuename=QUEUE1 /input /output" which works perfectly.

How can integrate Yarn queue binding with Sqoop when you run a sqoop query?

ie. sqoop import \ --connect 'jdbc://server' \ --target-dir \ and what ?


回答1:


Use the same method for Sqoop as well i.e

sqoop import -Dmapreduce.job.queuename=NameOfTheQueue\ --connect 'jdbc://server' \ --target-dir \

Note that, the mapreduce.job.queuename parameter should be used after the import but before the connect or other options.



来源:https://stackoverflow.com/questions/29607451/sqoop-binding-to-yarn-queues

易学教程内所有资源均来自网络或用户发布的内容,如有违反法律规定的内容欢迎反馈
该文章没有解决你所遇到的问题?点击提问,说说你的问题,让更多的人一起探讨吧!