User-agent: * Disallow: /forums/ Disallow: /delete1/ Disallow: /delete2/ Disallow: /delete3/ Disallow: /delete4/ Disallow: /delete5/ Disallow: /delete6/ Disallow: /delete7/ Disallow: /delete8/ # comment robots.txt # user-agent allows all search engines to index # disallow prevents folders or pages from being indexed.