# Robot Exclusion File -- robots.txt # Author: Anurag # Last Updated: 09/02/2009 User-agent: * Disallow: /includes/ Disallow: /scripts/ Disallow: /downloads/ Disallow: /online/ Disallow: /_notes/ Disallow: /_private/ Disallow: /cgi-bin/ Disallow: /olddirectories/ Disallow: /doc/ Disallor: /magazines/