Scrape web pages in real time with Node.js

前端 未结 8 2180
闹比i
闹比i 2020-11-29 15:43

What\'s a good was to scrape website content using Node.js. I\'d like to build something very, very fast that can execute searches in the style of kayak.com, where one query

8条回答
  •  野趣味
    野趣味 (楼主)
    2020-11-29 16:38

    It is my easy to use general purpose scrapper https://github.com/harish2704/html-scrapper written for Node.JS It can extract information based on predefined schemas. A schema defnition includes a css selector and a data extraction function. It currently using cheerio for dom parsing..

提交回复
热议问题