How to set different scrapy-settings for different spiders?

前端 未结 5 1659
逝去的感伤
逝去的感伤 2020-12-05 14:48

I want to enable some http-proxy for some spiders, and disable them for other spiders.

Can I do something like this?

# settings.py
proxy_spiders = [         


        
5条回答
  •  悲&欢浪女
    2020-12-05 15:05

    There is a new and easier way to do this.

    class MySpider(scrapy.Spider):
        name = 'myspider'
    
        custom_settings = {
            'SOME_SETTING': 'some value',
        }
    

    I use Scrapy 1.3.1

提交回复
热议问题