Getting scrapy project settings when script is outside of root directory

Question

I have made a Scrapy spider that can be successfully run from a script located in the root directory of the project. As I need to run multiple spiders from different project

Answer 1

I used the OS module for this problem. The python file you are running is in one directory and your scrapy project is in a different directory. You can not simply just import the python spider and run on this python script because the current directory you are working in does not have the settings.py file or the scrapy.cfg.

import os

To show the current directory you are working in use the following code:

print(os.getcwd())

From here you are going to want to change the current directory:

os.chdir(\path\to\spider\folder)

Lastly, tell os which command to execute.

os.system('scrape_file.py')