# robots.txt for http://samhughes.org - tells engines NOT to search or index certain directories or pages User-agent: * Disallow: /_info Disallow: /backup/ Disallow: /cgi-bin Disallow: /Copy-samhughes Disallow: /Fireworks/ Disallow: /Library/ Disallow: /newsite/ Disallow: /not-in-use Disallow: /notes/ Disallow: /orphaned/ Disallow: /Templates/ Disallow: /xml-sitemaps/ # example of robot ban #User-agent: Xenu Link Sleuth 1.3.5 #Disallow: /