问题
how we get Data Factory logging information.
do Microsoft done any documentation. i need complete information when i run pipeline
i.e
Start time , end time, pipeline job id, no of record inserted, deleted, update, error, etc
回答1:
ADF doesn't currently write to the Azure Activity Logs, meaning you can't access details using the Azure Monitor.
Currently the best way I find to get this information is using PowerShell. For example:
Get-AzureRmDataFactoryActivityWindow `
-DataFactoryName $ADFName.DataFactoryName `
-ResourceGroupName $ResourceGroup `
| ? {$_.WindowStart -ge $Now} `
| SELECT ActivityName, ActivityType, WindowState, RunStart, InputDatasets, OutputDatasets `
| Sort-Object ActivityName
More info here: https://docs.microsoft.com/en-us/powershell/module/azurerm.datafactories/get-azurermdatafactoryactivitywindow?view=azurermps-4.0.0
Hope this helps
回答2:
The easiest way is to connect to the SSISDB in the server that package is deployed to in the ADF through SSMS. Once you have it open browse to the package -> Generate Reports -> All executions.
回答3:
If you use Python, you can use Azure Python SDK to access the pipeline_runs and activity_runs metadata and write to a database table.
来源:https://stackoverflow.com/questions/44259820/how-we-get-data-factory-logging-information