How to add `nofollow, noindex` all pages in robots.txt?

前端 未结 4 1366
半阙折子戏
半阙折子戏 2020-12-19 03:44

I want to add nofollow and noindex to my site whilst it\'s being built. The client has request I use these rules.

I am aware of

4条回答
  •  感动是毒
    2020-12-19 04:11

    noindex and nofollow means you do not want your site to crawl in search engine.

    so simply put code in robots.txt User-agent: * Disallow: /

    it means noindex and nofollow.

提交回复
热议问题