Do I need to respect robots.txt when automating a workflow (not crawling)?

前端 未结 0 882
情深已故
情深已故 2020-12-02 05:34

If I want to automate a simple workflow on a website (for example every month I need to go in and push a button to pay a bill, and would prefer to just have a cronjob run a

相关标签:
回答
  • 消灭零回复
提交回复
热议问题