Scrape web pages in real time with Node.js

前端 未结 8 2185
闹比i
闹比i 2020-11-29 15:43

What\'s a good was to scrape website content using Node.js. I\'d like to build something very, very fast that can execute searches in the style of kayak.com, where one query

8条回答
  •  北海茫月
    2020-11-29 16:37

    I've been doing research myself, and https://npmjs.org/package/wscraper boasts itself as a

    a web scraper agent based on cheerio.js a fast, flexible, and lean implementation of core jQuery; built on top of request.js; inspired by http-agent.js

    Very low usage (according to npmjs.org) but worth a look for any interested parties.

提交回复
热议问题