scrapy passing custom_settings to spider from script using CrawlerProcess.crawl()

后端 未结 4 1555
予麋鹿
予麋鹿 2021-01-05 09:19

I am trying to programatically call a spider through a script. I an unable to override the settings through the constructor using CrawlerProcess. Let me illustrate this with

4条回答
  •  梦毁少年i
    2021-01-05 10:01

    You can override a setting from the command line

    https://doc.scrapy.org/en/latest/topics/settings.html#command-line-options

    For example: scrapy crawl myspider -s LOG_FILE=scrapy.log

提交回复
热议问题