Performance issue with MultiResourcePartitioner in Spring Batch

我的梦境 提交于 2019-12-11 06:58:22

问题


I have a spring batch project that reads a huge zip file containing more than 100.000 xml files.

I am using MultiResourcePartitioner, and I have a Memory issue and my batch fails with

java.lang.OutOfMemoryError: GC overhead limit exceeded.

It seems like if all the xml files are loaded in memory and not garbaged after processing.

Is there a performant way to do this ?

Thanks.

来源:https://stackoverflow.com/questions/38793243/performance-issue-with-multiresourcepartitioner-in-spring-batch

易学教程内所有资源均来自网络或用户发布的内容,如有违反法律规定的内容欢迎反馈
该文章没有解决你所遇到的问题?点击提问,说说你的问题,让更多的人一起探讨吧!