Append data in existing file in U-SQL

旧城冷巷雨未停 提交于 2020-01-15 12:11:23

问题


Can we append data in existing file in U-SQL? I have created a CSV file as output in U-SQL. I am writing another U-SQL query and I want to append the output of that query in the existing file. Is it possible?


回答1:


It's not supported, and would go against the design of a robust, distributed, idempotent big data system (although you could implement that behaviour by reading the previous output as a rowset and do UNION ALL).

The best way to deal with this is to use partitions properly, for example, create one or more new partitions for each of your executions: https://msdn.microsoft.com/en-us/library/azure/mt621324.aspx



来源:https://stackoverflow.com/questions/40929858/append-data-in-existing-file-in-u-sql

易学教程内所有资源均来自网络或用户发布的内容,如有违反法律规定的内容欢迎反馈
该文章没有解决你所遇到的问题?点击提问,说说你的问题,让更多的人一起探讨吧!