Web activity throws overlimit error when calling rest api

柔情痞子 提交于 2019-12-11 13:33:45

问题


My ADF pipeline has a lookup activity which uses a sql query to get data from a table and passes it to a web activity which posts the JSON to an API (azure app service). When the query gets 1000 rows it works fine but when I try over 5000 rows the web activity returns the error.

"errorCode": "2001",
"message": "The length of execution ouput is over limit (around 1M currently). ",
"failureType": "UserError",

When I post the 5000 rows to the API using postman it works fine. Any idea what this error means and how to resolve it?

Thanks in advance.


回答1:


As you found, web activity has times out limitation for 1 minute. Also, based on the above error The length of execution output is over limit (around 1M currently)., web activity also has output size limitation for 1 MB.

You could find the limitation rules here and some of the them could be adjusted if you ask for Contact Support.

If nothing they can do,I provide you with a workaround that you could use ForEach Activity. Maybe you need to use paging query for your rest api and return a limited number of the data each time. Then query your data in loop until the number of return data is lower than threshold value.




回答2:


Looks like the web activity times out after 1 minute if the endpoint its calling doesn't respond.



来源:https://stackoverflow.com/questions/52843154/web-activity-throws-overlimit-error-when-calling-rest-api

易学教程内所有资源均来自网络或用户发布的内容,如有违反法律规定的内容欢迎反馈
该文章没有解决你所遇到的问题?点击提问,说说你的问题,让更多的人一起探讨吧!