User-agent: * Disallow: / User-Agent: nabot Disallow: / User-Agent: Googlebot Disallow: / User-Agent: ia_archiver Disallow: / User-Agent: fast Disallow: / User-Agent: ZyBorg Disallow: / User-Agent: ArchitextSpider Disallow: / User-Agent: slurp Disallow: / User-Agent: Slurp Disallow: / User-agent: girafa Disallow: / User-Agent: msnbot Disallow: / User-agent: DiaGem Disallow: / User-agent: SlySearch Disallow: / User-agent: Steeler Disallow: / User-agent: TurnitinBot Disallow: / User-Agent: sitecheck.internetseer.com Disallow: / User-Agent: NPBot Disallow: / User-agent: http://www.almaden.ibm.com/cs/crawler Disallow: / User-Agent: Openbot Disallow: / User-agent: mogimogi Disallow: / User-agent: searchpreview Disallow: / User-agent: e-SocietyRobot Disallow: / User-Agent: nicobot0.1 (+http://www.nicob.jp/?m=default&a=info&p=help) Disallow: / User-agent: HatenaScreenshot Disallow: / User-agent: baiduspider Disallow: /