问题
How to create a robots.txt file in a codeigniter project to hide a view page . where should i place this robots.txt file currently i have created file like this
User-agent: *
Disallow: /application/views/myviewpage.php
in side
/public_html/folder/robots.txt (Where i place my .htaccess file). Is there any way to test this?
回答1:
The robots.txt file MUST be placed in the document root of the host. It won’t work in other locations.
If your host is example.com, it needs to be accessible at http://example.com/robots.txt.
If your host is www.example.com, it needs to be accessible at http://www.example.com/robots.txt.
来源：https://stackoverflow.com/questions/19761737/how-to-create-a-robots-txt-file-to-hide-a-view-page-from-search-engines-in-codei