User-agent: KIT-Fireball/2.0 libwww/5.0a Disallow: / User-agent: CherryPicker Disallow: / User-agent: MwdSearch/0.1 Disallow: / User-agent: BackRub/*.* Disallow: / User-agent: HKU WWW Robot, Disallow: / User-agent: WWW-Collector-E Disallow: / User-agent: BlackWidow Disallow: / User-agent: Surfbot Disallow: / User-agent: JoeBot, Disallow: / User-agent: asterias Disallow: / User-agent: MerzScope Disallow: / User-agent: Wget/1.6 Disallow: / User-agent: Offline Explorer Disallow: / User-agent: Magpie/1.0 Disallow: / User-agent: NHSEWalker/3.0 Disallow: / User-agent: Merritt/1.0 Disallow: / User-agent: Xenu's Disallow: / User-agent: webvac/1.0 Disallow: / User-agent: gestaltIconoclast/1.0 libwww-FM/2.17 Disallow: / User-agent: yes Disallow: / User-agent: Road Runner: ImageScape Robot (lim@cs.leidenuniv.nl) Disallow: / User-agent: Ibot/1.0 libwww-perl/0.40 Disallow: /