Load a heavy links txt to scrapy

后端 未结 0 1528

i\'m trying to load scrapy a text file over 900mb, but scrapy says "error memory". So I have to split the file into 2 parts to be able to load it to scrapy.

相关标签:
回答
  • 消灭零回复
提交回复
热议问题