How to copy files and folder from one ADLS to another one on different subscription?

只愿长相守 提交于 2019-12-24 19:29:12

问题


I need to be able to copy files and folder from one DataLake to another DataLake on a different subscription, I'm in possession of both Auth Token and secret key.

I've tried different solution including:

https://medium.com/azure-data-lake/connecting-your-own-hadoop-or-spark-to-azure-data-lake-store-93d426d6a5f4

wich is involving hadoop but didn't worked on two different subscriptions, due to the site-core.xml wich only accept one subscripton.

ADLcopy didn't worked as well, neither DataFactory.

Any ideas? Can anyone point me in the right direction?


回答1:


Azure Data Factory supports such scenario, you need to create 2 AzureDataLakeStoreLinkedService, each with correct corresponding subscription and resource group (they don't necessarily be the same with the subscription of the data factory), and the credential of the service principal to access ADLS. If this doesn't answer your question, could you tell more of your scenario, as I don't understand this: " I'm trying to add both secret key and tokens of the two dirrent subscriptions in the core-site.xml", do you mean



来源:https://stackoverflow.com/questions/48910668/how-to-copy-files-and-folder-from-one-adls-to-another-one-on-different-subscript

易学教程内所有资源均来自网络或用户发布的内容,如有违反法律规定的内容欢迎反馈
该文章没有解决你所遇到的问题?点击提问,说说你的问题,让更多的人一起探讨吧!