Scrape web site generated by Javascript

后端 未结 2 1828
日久生厌
日久生厌 2020-12-04 03:37

I think this is a real challenging one!

I write a website for my local football league, www.rdyfl.co.uk , and include javascript code snippets from the F.A\'s Full-T

2条回答
  •  囚心锁ツ
    2020-12-04 04:24

    The latest version of OutWit Hub is doing a pretty good job on dynamic content. The source scraped by outwit to extract links, images, documents and tables and text is the updated DOM. You can certainly make a job to grab what you need using these. Custom scrapers are still applied to the static source in version 1.0.3 but version 1.1.x (still in beta) will offers the choice between the static source and the dynamically modified DOM.

提交回复
热议问题