how we get Data Factory logging information

你说的曾经没有我的故事 提交于 2019-12-24 08:29:01

问题


how we get Data Factory logging information.

do Microsoft done any documentation. i need complete information when i run pipeline

i.e

Start time , end time, pipeline job id, no of record inserted, deleted, update, error, etc


回答1:


ADF doesn't currently write to the Azure Activity Logs, meaning you can't access details using the Azure Monitor.

Currently the best way I find to get this information is using PowerShell. For example:

Get-AzureRmDataFactoryActivityWindow `
    -DataFactoryName $ADFName.DataFactoryName `
    -ResourceGroupName $ResourceGroup `
    | ? {$_.WindowStart -ge $Now} `
    | SELECT ActivityName, ActivityType, WindowState, RunStart, InputDatasets, OutputDatasets `
    | Sort-Object ActivityName

More info here: https://docs.microsoft.com/en-us/powershell/module/azurerm.datafactories/get-azurermdatafactoryactivitywindow?view=azurermps-4.0.0

Hope this helps




回答2:


The easiest way is to connect to the SSISDB in the server that package is deployed to in the ADF through SSMS. Once you have it open browse to the package -> Generate Reports -> All executions.




回答3:


If you use Python, you can use Azure Python SDK to access the pipeline_runs and activity_runs metadata and write to a database table.



来源:https://stackoverflow.com/questions/44259820/how-we-get-data-factory-logging-information

易学教程内所有资源均来自网络或用户发布的内容,如有违反法律规定的内容欢迎反馈
该文章没有解决你所遇到的问题?点击提问,说说你的问题,让更多的人一起探讨吧!