I want to enable some http-proxy for some spiders, and disable them for other spiders.
Can I do something like this?
# settings.py proxy_spiders = [
There is a new and easier way to do this.
class MySpider(scrapy.Spider): name = 'myspider' custom_settings = { 'SOME_SETTING': 'some value', }
I use Scrapy 1.3.1