Count scraped items from scrapy during execution and pause or sleep after a certain number of pages

前端 未结 0 1371
栀梦
栀梦 2020-12-31 18:29

I have more than 210000 links which I want to scrape. Is there any way we can print how many links it has completed scraping during the execution and sleep or pause executio

相关标签:
回答
  • 消灭零回复
提交回复
热议问题