Scraping dynamic content in a website

后端 未结 4 1556
梦如初夏
梦如初夏 2020-11-28 13:18

I need to scrape news announcements from this website, Link. The announcements seem to be generated dynamically. They dont appear in the source. I usually use mechanize but

4条回答
  •  遥遥无期
    2020-11-28 13:34

    If the content is generated dynamically, you can use Windmill or Seleninum to drive the browser and get the data once it's been rendered.

    You can find an example here.

提交回复
热议问题