Trying to parse html hidden by javascript

Question

I\'ve created a simple java script that used Jsoup to parse a page of data. The site creators have changed the page however, so much that if there is a certain amount of dat

Answer 1

Try to use something that drives a web browser like Selenium. That's the only one I have used, never needed anything else. I'm sure there are different ones that may suit you better, you should test a few, or not.. Once you get the javascript elements with selenium (or whatever web driver you choose) parse them into JSoup Elements. This way you wouldn't have to completely change libs, but just add one.

Also, there are ways you can work around javascript by watching what changes in browser's address bar.