Memory leak in Node.js scraper

前端 未结 4 1913
小鲜肉
小鲜肉 2021-02-04 13:23

This is a simple scraper written in JavaScript with Node.js, for scraping Wikipedia for periodic table element data. The dependencies are jsdom for DOM manipulation and chain-ga

4条回答
  •  不要未来只要你来
    2021-02-04 13:57

    For jQuery-like html processing with node i use now cheerio instead of jsdom. So far, i have not seen any memory leaks while scrapping and parsing over 10K pages for a couple of hours.

提交回复
热议问题