User-agent: msnbot Crawl-delay: 10 Disallow: /*.PDF$ Disallow: /*.jpeg$ Disallow: /*.jpg$ Disallow: /*.gif$ Disallow: /*.exe$ Disallow: /Graphics/* Disallow: /graphics/* Disallow: /images/* User-agent: Yahoo-MMCrawler Crawl-delay: 10 Disallow: /Graphics/* Disallow: /graphics/* Disallow: /images/* User-agent: * Disallow: /css/* Disallow: /graphics/* Disallow: /Graphics/* Disallow: /images/* Disallow: /*.PDF$ Disallow: /*.jpeg$ Disallow: /*.jpg$ Disallow: /*.gif$ Disallow: /*.exe$ Disallow: /1mhpu.htm Disallow: /1mhpu.js Disallow: /an/a/s/* Disallow: /bbo/b/s/* Disallow: /boc/b/s/* Disallow: /bpg/b/s/* Disallow: /carfax/c/s/* Disallow: /credit/c/s/* Disallow: /denise-calla/d/s/* Disallow: /clothique/c/s/* Disallow: /sge/s/s/* Disallow: /lemon-protection/l/s/* Disallow: /merchant-account/m/s/* Disallow: /ohb/o/s/* Disallow: /pins/p/s/* Disallow: /pfs/p/s/* Disallow: /radar/r/s/* Disallow: /vin/v/s/* Disallow: /ys/y/s/* Disallow: /taj/t/s/* Disallow: /cco/c/s/* Disallow: /gm/g/s/* Disallow: /pw/p/s/* Disallow: /ht/h/s/* Disallow: /fao/f/s/* Disallow: /fao2/f/s/* Disallow: /og/o/s/* Disallow: /poker/p/s/* Disallow: /personals/p/s/* Disallow: /phentermine/p/s/* Disallow: /oip/o/s/* Disallow: /fos/f/s/* Disallow: /pep/p/s/* Disallow: /bl/b/s/* Disallow: /as/a/s/* Disallow: /fs/s/s/* Disallow: /hgh/h/s/* Disallow: /software/s/s/* Disallow: /spas/s/s/* Disallow: /copydvd/c/s/* Disallow: /dvd/d/s/* Disallow: /hr/h/s/* Disallow: /sp/s/s/* Disallow: /or/o/s/* Disallow: /slvr/s/s/* Crawl-delay: 10 User-agent: BecomeBot Crawl-Delay: 15 Disallow: /Graphics User-agent: SBIder Disallow: / User-agent: Mercator-1.0 Disallow: / User-agent: Mercator Disallow: / User-agent: LEIA/2.90 Disallow: / User-agent: LEIA/3.01pr (LEIAcrawler; leia@gseek.com; http://www.gseek.com) Disallow: / User-agent: LEIA/3.01 Disallow: / User-agent: LEIA Disallow: / User-agent: DaviesBot/1.7 (www.wholeweb.net) Disallow: / User-agent: ia_archiver Disallow: / User-Agent: sitecheck.internetseer.com Disallow: / User-agent: psbot Disallow: / User-agent: SurveyBot Disallow: / User-agent: TurnitinBot Disallow: / User-agent: linksmanager Disallow: / User-agent: szukacz disallow: / User-agent: NPBot disallow: / User-agent: NPbot disallow: / User-agent: grub-client Disallow: / User-agent: MSIECrawler Disallow: / User-agent: Antibot Disallow: / User-agent: Tkensaku Disallow: / User-agent: IRLbot Disallow: / User-agent: Slurp Crawl-delay: 4 User-agent: e-SocietyRobot Disallow: /