tag for Google

Question

I would like to tell Google not to index certain parts of the page. In Yandex (russian SE) there\'s a very useful tag called . How can it be done

Answer 1

Create a robots.txt file at your root level and insert something like the following:

Block Google:

User-agent: Googlebot
Disallow: /myDisallowedDir1/
Disallow: /myDisallowedPage.html
Disallow: /myDisallowedDir2/

Block all bots:

User-agent: *
Disallow: /myDisallowedDir1/
Disallow: /myDisallowedPage.html
Disallow: /myDisallowedDir2/

A handy robots.txt generator:

http://www.mcanerin.com/EN/search-engine/robots-txt.asp