azure-data-factory-2

来源： https://stackoverflow.com/questions/63337199/azure-adf-expression-that-returns-either-an-existing-array-or-an-empty-array-b

来源： https://stackoverflow.com/questions/63337199/azure-adf-expression-that-returns-either-an-existing-array-or-an-empty-array-b

来源： https://stackoverflow.com/questions/63337300/azure-adf-getmetadata-childitems-if-folder-might-not-exist

来源： https://stackoverflow.com/questions/63207259/azure-datalake-analytics-u-sql-with-azure-datalake-storage-gen-2

来源： https://stackoverflow.com/questions/63207259/azure-datalake-analytics-u-sql-with-azure-datalake-storage-gen-2

问题 Is there a way to reference the output of an executed pipeline in the activity "Execute pipeline"? I.e.: master pipeline executes 2 pipelines in sequence. The first pipeline generates an own created run_id that needs to be forwarded as a parameter to the second pipeline. I've read the documentation and checked that the master pipeline log the output of the first pipeline, but it looks like that this is not directly possible? We've used until now only 2 pipelines without a master pipeline, but

问题 How do I pass in parameters at runtime to a Linked Service in Data Factory? I have a parameter defined and consumed in my Azure Function linked service definition, but am unsure how I set that during invocation in my pipeline action. In this case I would like to set functionAlias in a trigger to set the Azure Function hostname. Currently an exception is returned on (blob create) trigger stating that functionAlias is not specified. Pipeline { "name": "myActivity", "type":

问题 I've been trying to find the best way to trigger an alert when an ADF task (i.e. CopyActivity or Stored Procedure Task) has been running for more than N hours, I wanted to use the Azure Monitor as it is one of the recommended notification services in Azure, however I have not been able to find a "Running" criteria, hence I had to play with the available criteria (Succeeded and Failed) and check this every N hours, however this is still not perfect as I don't know when the process started and

问题 I have some data factory pipelines which may sometimes run beyond 2 hours when copying data from blob into SQL. The time period is variable, but I'd like to be notified/alerted when any pipeline runs beyond 2 hours. What are possible ways of doing this? What I have tried so far: Explored the adf metrics on which I can put an alert rule. But there seems to be none which talks about active run's duration. I was hoping to get Pipeline's duration value as we see it on the monitor tab in adf.azure

问题 I have some data factory pipelines which may sometimes run beyond 2 hours when copying data from blob into SQL. The time period is variable, but I'd like to be notified/alerted when any pipeline runs beyond 2 hours. What are possible ways of doing this? What I have tried so far: Explored the adf metrics on which I can put an alert rule. But there seems to be none which talks about active run's duration. I was hoping to get Pipeline's duration value as we see it on the monitor tab in adf.azure