Crawling a site recursively using scrapy

来源：https://stackoverflow.com/questions/34501458/crawling-a-site-recursively-using-scrapy