Scrapy Shell and Scrapy Splash

Question

We\'ve been using scrapy-splash middleware to pass the scraped HTML source through the Splash javascript engine running inside a docker container.

If we

Answer 1

You can run scrapy shell without arguments inside a configured Scrapy project, then create req = scrapy_splash.SplashRequest(url, ...) and call fetch(req).