My Scrapy script seems to work just fine when I run it in \'one off\' scenarios from the command line, but if I try running the code twice in the same python session I get t
Seems to me that you cannot use crawler.start() command twice: you may have to re-create it if you want it to run a second time.
crawler.start()