#Rule to block the alexa / archive.org robot User-agent: ia_archiver Disallow: / #Rule to block the internetseer bot User-agent: sitecheck.internetseer.com Disallow: / #Rule to block the whois.sc bot User-agent: SurveyBot Disallow: / #Rules to block the nameprotect.com bot User-agent: NPBot Disallow: / User-agent: aipbot Disallow: / #Rule for all robots User-agent: * Disallow: /framework/ Disallow: /image/ Disallow: /jscript/ Disallow: /w3c/ Disallow: /usr/ Disallow: /rss/ Disallow: /rss_asp/ Disallow: /content/code_sqlloginaudit/wordlist.txt Disallow: /helpers/tracker_as_2004_03.asp Disallow: /helpers/tracker_as_psa.asp Disallow: /devlog/ Disallow: /photo/ Disallow: /legal/