U-SQL Job Failing in Data Factory

问题

I keep getting following error from Data Factory whenever I run an U-SQL Job

Job submission failed, the user 'adla account name' does not have permissions to a subfolder in the /system/ path needed by Data Lake Analytics. Please run “Add User Wizard” from the Data Lake Analytics Azure Portal or use Azure PowerShell to grant access for the user to the /system/ and its children on the Data Lake Store.

And I am not using any Firewall as suggested in this post:

Run U-SQL Script from C# code with Azure Data Factory

I am using the Azure Data Lake Store service principal authentication. When I start the Job from Visual Studio, it also works fine.

I would be grateful for any idea...

thanks

回答1:

It does sound like a permissions problem. You can run this powershell script to ensure you have applied the proper permissions to the security principal:

Login-AzureRmAccount
$appname = “adla”
$dataLakeStoreName = “yourdatalakename”

$app = Get-AzureRmADApplication -DisplayName $appname

$servicePrincipal = Get-AzureRmADServicePrincipal  -SearchString $appname

Set-AzureRmDataLakeStoreItemAclEntry -AccountName $dataLakeStoreName -Path / -AceType User -Id $servicePrincipal.Id -Permissions All

Set-AzureRmDataLakeStoreItemAclEntry -AccountName $dataLakeStoreName -Path /system -AceType User -Id $servicePrincipal.Id -Permissions All

If you want to create everything from scratch using a powershell script, here is a blog that will help you:

http://dyor.com/setting-up-an-azure-data-lake-and-azure-data-factory-using-powershell/

回答2:

If you are authorising the Azure Data Lake Analytics linked service from Azure Data Factory with a service principal that could be your problem.

I have an outstanding support ticket with Microsoft because the service principal authentication method only works with simple data factory activities like 'copy'. It does not work if you want to authenticate complex activities like 'DotNotActivity'.

My advise would be to change the linked service back to using session and token auth, then deploy your activities and try again.

Hope this helps.

来源：https://stackoverflow.com/questions/44925343/u-sql-job-failing-in-data-factory