# See http://www.robotstxt.org/wc/norobots.html for documentation on how to use the robots.txt file # # Disallow all robots (bad for SEO) # User-Agent: * # Disallow: / User-Agent: * Disallow: # User-Agent: Googlebot # Disallow: User-Agent: NextGenSearchBot Disallow: /