# www.robotstxt.org/ # www.google.com/support/webmasters/bin/answer.py?hl=en&answer=156449 # For the noindex directive to be effective, the page must not be blocked by this file. # If the page is blocked by a robots.txt file, the crawler will never see the noindex directive in bvg theme, and the page can still appear in search results, for example if other pages link to it User-agent: *