How to release new Items in Scrapy in case item is not needed?

后端 未结 0 1340
梦毁少年i
梦毁少年i 2020-12-25 13:20

I am running Scrapy 2.4 spiders in parallel that last for up to 24 hours per crawl. Especially at the end of the day the memory usage will accumulate constantly until the se

相关标签:
回答
  • 消灭零回复
提交回复
热议问题