how to call output filename from scrapy

﹥>﹥吖頭↗ 提交于 2020-01-11 10:25:11

问题


scrapy crawl test -o test123.csv

How can I call the Output filename from code i.e I would like to use the filename inputed in terminal in spider_closed function

@classmethod
def from_crawler(cls, crawler, *args, **kwargs):
    spider = super(MySpider, cls).from_crawler(crawler, *args, **kwargs)
    crawler.signals.connect(spider.spider_closed, signal=scrapy.signals.spider_closed)
def spider_closed(self):
    #read test123.csv (whatever the filename is)

回答1:


You can use self.settings.attributes["FEED_URI"].value in your spider to get output file name.



来源:https://stackoverflow.com/questions/57047023/how-to-call-output-filename-from-scrapy

标签
易学教程内所有资源均来自网络或用户发布的内容,如有违反法律规定的内容欢迎反馈
该文章没有解决你所遇到的问题?点击提问,说说你的问题,让更多的人一起探讨吧!