# # This is a robots.txt file that can be used to indicate to # WWW robots which parts of a web site should not be indexed. # # Following page has details on how to setup a robots.txt file and # related security issues: # # http://www.chami.com/tips/internet/010198I.html # # 1. Uncomment following lines by removing "#" at the beginning to # indicate that all robots should stay away from the /cgi-bin/ folder User-agent: * Disallow: /cgi-local/ Disallow: /bin/ Disallow: /etc/ Disallow: /assets/ Disallow: /dwg/ Disallow: /pub/ Disallow: /stats/ Disallow: /temp/ # #Disallow: *.eml #Disallow: *.txt #Disallow: contact.shtml #