The way to detect web scraping

后端 未结 4 1311
旧巷少年郎
旧巷少年郎 2020-12-30 08:29

I need to detect scraping of info on my website. I tried detection based on behavior patterns, and it seems to be promising, although relatively computing heavy.

The

4条回答
  •  不思量自难忘°
    2020-12-30 09:04

    I do a lot of web scraping and always use multiple IP addresses and random intervals between each request.

    When scraping a page I typically only download the HTML and not the dependencies (images, CSS, etc). So you could try checking if the user downloads these dependencies.

提交回复
热议问题