Based on Scrapy : Program organization when interacting with secondary website , I have:
class MyPipeline(object): def __init__(self, crawler): self.