问题
I need to be able to copy files and folder from one DataLake to another DataLake on a different subscription, I'm in possession of both Auth Token and secret key.
I've tried different solution including:
https://medium.com/azure-data-lake/connecting-your-own-hadoop-or-spark-to-azure-data-lake-store-93d426d6a5f4
wich is involving hadoop but didn't worked on two different subscriptions, due to the site-core.xml wich only accept one subscripton.
ADLcopy didn't worked as well, neither DataFactory.
Any ideas? Can anyone point me in the right direction?
回答1:
Azure Data Factory supports such scenario, you need to create 2 AzureDataLakeStoreLinkedService, each with correct corresponding subscription and resource group (they don't necessarily be the same with the subscription of the data factory), and the credential of the service principal to access ADLS. If this doesn't answer your question, could you tell more of your scenario, as I don't understand this: " I'm trying to add both secret key and tokens of the two dirrent subscriptions in the core-site.xml", do you mean
来源:https://stackoverflow.com/questions/48910668/how-to-copy-files-and-folder-from-one-adls-to-another-one-on-different-subscript