Why does scrapy throw an error for me when trying to spider and parse a site?

Question

The following code

class SiteSpider(BaseSpider):
    name = \"some_site.com\"
    allowed_domains = [\"some_site.com\"]
    start_urls = [
        \"some_sit         


        

Answer 1

I needed to change BaseSpider to CrawlSpider. Thanks srapy users!

http://groups.google.com/group/scrapy-users/browse_thread/thread/4adaba51f7bcd0af#

Hi Bob,

Perhaps it might work if you change from BaseSpider to CrawlSpider? The BaseSpider seems not implement Rule, see:

http://doc.scrapy.org/topics/spiders.html?highlight=rule#scrapy.contr...

-M