Python Scrapy - How can I reset/clear memory of visited urls for scrapy “dont_filter=False”?

前端 未结 0 1206
-上瘾入骨i
-上瘾入骨i 2020-11-29 21:57

I have a website that have the same urls when I am searching for different things. I need my spider to have dont_filter=False on several methods to not duplicat

相关标签:
回答
  • 消灭零回复
提交回复
热议问题