# This is a robots.txt file that can be used to indicate to # WWW robots which parts of a web site should not be indexed. # # All robots should stay away from the /cgi-bin/ folder User-agent: * Disallow: /cgi-bin/