Java-Scrape a dynamic website with JSoup

Question

I would like to scrape a website with JSoup. This website is dynamic and updates every second or so. I\'m pretty sure it uses JQuery, which updates some tags in the HTML. I

Answer 1

Sounds like you want JSoup to behave like a browser with JavaScript support. That won't work, I'm afraid. JSoup is a tool that can execute a HTTP request, and then use the response body for something useful.

This 'something useful' is to extract information from the (X)HTML text in the response. If you want to the contents of subsequent ajax-request following the loading of a JavaScript-infused HTML page (=dynamic web page) you'll need to model those follow-up requests yourself and instruct JSoup to execute those for you manually.