Should we delete DataLake Analytic Job after completion?

巧了我就是萌 提交于 2019-12-08 07:19:23

问题


We are submitting U-SQL jobs very frequently and we a see a list of jobs previously submitted in ADLA.

We see the total storage utilization of Data Lake store is increasing day by day. All of our jobs submitted only update one single output file and size is around 10 MB.

The current storage utilization of Data Lake store is 9.3 GB. We think it's due to the previous jobs resources are still saved in the Data Lake. Should we take care of this or we should do something here?


回答1:


I think the job data expires after a couple of weeks, but if you are concerned and do not need the data for auditing or investigations, feel free to delete them.

Given that the store has no limit and the storage cost 4c/GB/month according to the current pricing website, it is not a big cost though.




回答2:


You can go to /system/jobservice/jobs/usql/year/month/date.. Feel free to delete the folders that you don't need any more.



来源:https://stackoverflow.com/questions/37003660/should-we-delete-datalake-analytic-job-after-completion

易学教程内所有资源均来自网络或用户发布的内容,如有违反法律规定的内容欢迎反馈
该文章没有解决你所遇到的问题?点击提问,说说你的问题,让更多的人一起探讨吧!