Where should we modify scrapy to remember the website that caused a 403 while scraping?

前端未结

关注

 0  857

I have a Scrapy scraper that and I would like to record the urls that a 403 returns to me:

>>>scrapy crawl myscraper -o results.jl
...
2020-11-11 02:


                      
              相关标签: