Scraping websites with Javascript enabled?

Question

I\'m trying to scrape and submit information to websites that heavily rely on Javascript to do most of its actions. The website won\'t even work when i disable Javascript in

Answer 1

I would actually suggest using Selenium. Its mainly designed for testing Web-Applications from a "user perspective however it is basically a "FireFox" driver. I've actually used it for this purpose ... although I was scapping an dynamic AJAX webpage. As long as the Javascript form has a recognizable "Anchor Text" that Selenium can "click" everything should sort itself out.

Hope that helps