User-Agent: * Disallow: User-Agent: Jyxobot Disallow: User-Agent: Googlebot Disallow: User-Agent: Seznambot Disallow: User-Agent: Slurp Disallow: User-Agent: Gulliver Disallow: User-Agent: ABCdatos BotLink Disallow: User-Agent: Acme.Spider Disallow: User-Agent: Ahoy! The Homepage Finder Disallow: User-Agent: Alkaline Disallow: User-Agent: Anthill Disallow: User-Agent: Walhello appie Disallow: User-Agent: Arachnophilia Disallow: User-Agent: Arale Disallow: User-Agent: Araneo Disallow: User-Agent: AraybOt Disallow: User-Agent: ArchitextSpider Disallow: User-Agent: Aretha Disallow: User-Agent: ARIADNE Disallow: User-Agent: arks Disallow: User-Agent: ASpider (Associative Spider) Disallow: User-Agent: ATN Worldwide Disallow: User-Agent: Atomz.com Search Robot Disallow: User-Agent: AURESYS Disallow: User-Agent: BackRub Disallow: User-Agent: unnamed Disallow: User-Agent: BBot Disallow: User-Agent: Big Brother Disallow: User-Agent: Bjaaland Disallow: User-Agent: BlackWidow Disallow: User-Agent: Die Blinde Kuh Disallow: User-Agent: Bloodhound Disallow: User-Agent: Borg-Bot Disallow: User-Agent: BoxSeaBot Disallow: User-Agent: bright.net caching robot Disallow: User-Agent: BSpider Disallow: User-Agent: CACTVS Chemistry Spider Disallow: User-Agent: Calif Disallow: User-Agent: Cassandra Disallow: User-Agent: Digimarc Marcspider/CGI Disallow: User-Agent: Checkbot Disallow: User-Agent: ChristCrawler.com Disallow: User-Agent: churl Disallow: User-Agent: cIeNcIaFiCcIoN.nEt Disallow: User-Agent: CMC/0.01 Disallow: User-Agent: Collective Disallow: User-Agent: Combine System Disallow: User-Agent: ConfuzzledBot Disallow: User-Agent: CoolBot Disallow: User-Agent: Web Core / Roots Disallow: User-Agent: XYLEME Robot Disallow: User-Agent: Internet Cruiser Robot Disallow: User-Agent: Cusco Disallow: User-Agent: CyberSpyder Link Test Disallow: User-Agent: CydralSpider Disallow: User-Agent: Desert Realm Spider Disallow: User-Agent: DeWeb(c) Katalog/Index Disallow: User-Agent: DienstSpider Disallow: User-Agent: Digger Disallow: User-Agent: Digital Integrity Robot Disallow: User-Agent: Direct Hit Grabber Disallow: User-Agent: DNAbot Disallow: User-Agent: DownLoad Express Disallow: User-Agent: DragonBot Disallow: User-Agent: DWCP (Dridus' Web Cataloging Project) Disallow: User-Agent: e-collector Disallow: User-Agent: EbiNess Disallow: User-Agent: EIT Link Verifier Robot Disallow: User-Agent: ELFINBOT Disallow: User-Agent: Emacs-w3 Search Engine Disallow: User-Agent: ananzi Disallow: User-Agent: esculapio Disallow: User-Agent: Esther Disallow: User-Agent: Evliya Celebi Disallow: User-Agent: nzexplorer Disallow: User-Agent: FastCrawler Disallow: User-Agent: Fluid Dynamics Search Engine robot Disallow: User-Agent: Felix IDE Disallow: User-Agent: Wild Ferret Web Hopper User-Agent:1, User-Agent:2, User-Agent:3 Disallow: User-Agent: FetchRover Disallow: User-Agent: fido Disallow: User-Agent: Hämähäkki Disallow: User-Agent: KIT-Fireball Disallow: User-Agent: Fish search Disallow: User-Agent: Fouineur Disallow: User-Agent: Robot Francoroute Disallow: User-Agent: Freecrawl Disallow: User-Agent: FunnelWeb Disallow: User-Agent: gammaSpider, FocusedCrawler Disallow: User-Agent: gazz Disallow: User-Agent: GCreep Disallow: User-Agent: GetBot Disallow: User-Agent: GetURL Disallow: User-Agent: Golem Disallow: User-Agent: Grapnel/0.01 Experiment Disallow: User-Agent: Griffon Disallow: User-Agent: Gromit Disallow: User-Agent: Northern Light Gulliver Disallow: User-Agent: Gulper Bot Disallow: User-Agent: HamBot Disallow: User-Agent: Harvest Disallow: User-Agent: havIndex Disallow: User-Agent: HI (HTML Index) Search Disallow: User-Agent: Hometown Spider Pro Disallow: User-Agent: Wired Digital Disallow: User-Agent: ht://Dig Disallow: User-Agent: HTMLgobble Disallow: User-Agent: Hyper-Decontextualizer Disallow: User-Agent: iajaBot Disallow: User-Agent: IBM_Planetwide Disallow: User-Agent: Popular Iconoclast Disallow: User-Agent: Ingrid Disallow: User-Agent: Imagelock Disallow: User-Agent: IncyWincy Disallow: Disallow: User-Agent: Informant Disallow: User-Agent: InfoSeek Robot 1.0 Disallow: User-Agent: Infoseek Sidewinder Disallow: User-Agent: InfoSpiders Disallow: User-Agent: Inspector Web Disallow: User-Agent: IntelliAgent Disallow: User-Agent: I, Robot Disallow: User-Agent: Iron33 Disallow: User-Agent: Israeli-search Disallow: User-Agent: JavaBee Disallow: User-Agent: JBot Java Web Robot Disallow: User-Agent: JCrawler Disallow: User-Agent: AskJeeves Disallow: User-Agent: JoBo Java Web Robot Disallow: User-Agent: Jobot Disallow: User-Agent: JoeBot Disallow: User-Agent: The Jubii Indexing Robot Disallow: User-Agent: JumpStation Disallow: User-Agent: image.kapsi.net Disallow: User-Agent: Katipo Disallow: User-Agent: KDD-Explorer Disallow: User-Agent: Kilroy Disallow: User-Agent: KO_Yappo_Robot Disallow: User-Agent: LabelGrabber Disallow: User-Agent: larbin Disallow: User-Agent: legs Disallow: User-Agent: Link Validator Disallow: User-Agent: LinkScan Disallow: User-Agent: LinkWalker Disallow: User-Agent: Lockon Disallow: User-Agent: logo.gif Crawler Disallow: User-Agent: Lycos Disallow: User-Agent: Mac WWWWorm Disallow: User-Agent: Magpie Disallow: User-Agent: marvin/infoseek Disallow: User-Agent: Mattie Disallow: User-Agent: MediaFox Disallow: User-Agent: MerzScope Disallow: User-Agent: NEC-MeshExplorer Disallow: User-Agent: MindCrawler Disallow: User-Agent: mnoGoSearch search engine software Disallow: User-Agent: moget Disallow: User-Agent: MOMspider Disallow: User-Agent: Monster Disallow: User-Agent: Motor Disallow: User-Agent: MSNBot Disallow: User-Agent: Muncher Disallow: User-Agent: Muninn Disallow: User-Agent: Muscat Ferret Disallow: User-Agent: Mwd.Search Disallow: User-Agent: Internet Shinchakubin Disallow: User-Agent: NDSpider Disallow: User-Agent: NetCarta WebMap Engine Disallow: User-Agent: NetMechanic Disallow: User-Agent: NetScoop Disallow: User-Agent: newscan-online Disallow: User-Agent: NHSE Web Forager Disallow: User-Agent: Nomad Disallow: User-Agent: The NorthStar Robot Disallow: User-Agent: ObjectsSearch Disallow: User-Agent: Occam Disallow: User-Agent: HKU WWW Octopus Disallow: User-Agent: OntoSpider Disallow: User-Agent: Openfind data gatherer Disallow: User-Agent: Orb Search Disallow: User-Agent: Pack Rat Disallow: User-Agent: PageBoy Disallow: User-Agent: ParaSite Disallow: User-Agent: Patric Disallow: User-Agent: pegasus Disallow: User-Agent: The Peregrinator Disallow: User-Agent: PerlCrawler 1.0 Disallow: User-Agent: Phantom Disallow: User-Agent: PhpDig Disallow: User-Agent: PiltdownMan Disallow: User-Agent: Pimptrain.com's robot Disallow: User-Agent: Pioneer Disallow: User-Agent: html_analyzer Disallow: User-Agent: Portal Juice Spider Disallow: User-Agent: PGP Key Agent Disallow: User-Agent: PlumtreeWebAccessor Disallow: User-Agent: Poppi Disallow: User-Agent: PortalB Spider Disallow: User-Agent: psbot Disallow: User-Agent: GetterroboPlus Puu Disallow: User-Agent: The Python Robot Disallow: User-Agent: Raven Search Disallow: User-Agent: RBSE Spider Disallow: User-Agent: Resume Robot Disallow: User-Agent: RoadHouse Crawling System Disallow: User-Agent: RixBot Disallow: User-Agent: Road Runner: The ImageScape Robot Disallow: User-Agent: Robbie the Robot Disallow: User-Agent: ComputingSite Robi/1.0 Disallow: User-Agent: RoboCrawl Spider Disallow: User-Agent: RoboFox Disallow: User-Agent: Robozilla Disallow: User-Agent: Roverbot Disallow: User-Agent: RuLeS Disallow: User-Agent: SafetyNet Robot Disallow: User-Agent: Scooter Disallow: User-Agent: Search.Aus-AU.COM Disallow: User-Agent: Sleek Disallow: User-Agent: SearchProcess Disallow: User-Agent: Senrigan Disallow: User-Agent: SG-Scout Disallow: User-Agent: ShagSeeker Disallow: User-Agent: Shai'Hulud Disallow: User-Agent: Sift Disallow: User-Agent: Simmany Robot Ver1.0 Disallow: User-Agent: Site Valet Disallow: User-Agent: SiteTech-Rover Disallow: User-Agent: Skymob.com Disallow: User-Agent: SLCrawler Disallow: User-Agent: Inktomi Slurp Disallow: User-Agent: Smart Spider Disallow: User-Agent: Snooper Disallow: User-Agent: Solbot Disallow: User-Agent: Speedy Spider Disallow: User-Agent: spider_monkey Disallow: User-Agent: SpiderBot Disallow: User-Agent: Spiderline Crawler Disallow: User-Agent: SpiderMan Disallow: User-Agent: SpiderView(tm) Disallow: User-Agent: Spry Wizard Robot Disallow: User-Agent: Site Searcher Disallow: User-Agent: Suke Disallow: User-Agent: suntek search engine Disallow: User-Agent: Sven Disallow: User-Agent: Sygol Disallow: User-Agent: TACH Black Widow Disallow: User-Agent: Tarantula Disallow: User-Agent: tarspider Disallow: User-Agent: Tcl W3 Robot Disallow: User-Agent: TechBOT Disallow: User-Agent: Templeton Disallow: User-Agent: TitIn Disallow: User-Agent: TITAN Disallow: User-Agent: The TkWWW Robot Disallow: User-Agent: TLSpider Disallow: User-Agent: UCSD Crawl Disallow: User-Agent: UdmSearch Disallow: User-Agent: UptimeBot Disallow: User-Agent: URL Check Disallow: User-Agent: URL Spider Pro Disallow: User-Agent: Valkyrie Disallow: User-Agent: Verticrawl Disallow: User-Agent: Victoria Disallow: User-Agent: vision-search Disallow: User-Agent: void-bot Disallow: User-Agent: Voyager Disallow: User-Agent: VWbot Disallow: User-Agent: The NWI Robot Disallow: User-Agent: W3M2 Disallow: User-Agent: WallPaper (alias crawlpaper) Disallow: User-Agent: the World Wide Web Wanderer Disallow: User-Agent: w@pSpider by wap4.com Disallow: User-Agent: WebBandit Web Spider Disallow: User-Agent: WebCatcher Disallow: User-Agent: WebCopy Disallow: User-Agent: webfetcher Disallow: User-Agent: The Webfoot Robot Disallow: User-Agent: Webinator Disallow: User-Agent: weblayers Disallow: User-Agent: WebLinker Disallow: User-Agent: WebMirror Disallow: User-Agent: The Web Moose Disallow: User-Agent: WebQuest Disallow: User-Agent: Digimarc MarcSpider Disallow: User-Agent: WebReaper Disallow: User-Agent: webs Disallow: User-Agent: Websnarf Disallow: User-Agent: WebSpider Disallow: User-Agent: WebVac Disallow: User-Agent: webwalk Disallow: User-Agent: WebWalker Disallow: User-Agent: WebWatch Disallow: User-Agent: Wget Disallow: User-Agent: whatUseek Winona Disallow: User-Agent: WhoWhere Robot Disallow: User-Agent: Weblog Monitor Disallow: User-Agent: w3mir Disallow: User-Agent: WebStolperer Disallow: User-Agent: The Web Wombat Disallow: User-Agent: The World Wide Web Worm Disallow: User-Agent: WWWC Ver 0.2.5 Disallow: User-Agent: WebZinger Disallow: User-Agent: XGET Disallow: User-Agent: Nederland.zoek Disallow: