I have 20 spiders in one project, each spider has different task and URL to crawl ( but data are similar and I\'m using shared items.py and pipelines.py>
items.py
pipelines.py>
why not just use this
# with some condition sys.exit("Closing the spider")