Scrapy dupefilter filtering redirects even with dont_filter=True

前端 未结 0 1304
南旧
南旧 2020-12-10 06:32

I\'m trying to scrape a page that redirects me a few times to itself (bouncing between http and https) before finally responding:

2020-11-06 11:24:38 [scrapy.         


        
相关标签:
回答
  • 消灭零回复
提交回复
热议问题