Scrapy crawler in Cron job

后端 未结 7 1654
遥遥无期
遥遥无期 2020-12-13 15:11

I want to execute my scrapy crawler from cron job .

i create bash file getdata.sh where scrapy project is located with it\'s spiders

#!/bin/bash
cd /         


        
7条回答
  •  夕颜
    夕颜 (楼主)
    2020-12-13 15:32

    I solved this problem including PATH into bash file

    #!/bin/bash
    
    cd /myfolder/crawlers/
    PATH=$PATH:/usr/local/bin
    export PATH
    scrapy crawl my_spider_name
    

提交回复
热议问题