User-agent: * Disallow: / User-agent: Slurp Disallow: / User-Agent: fast Disallow: / User-Agent: NextGenSearchBot 1 (for information visit http://www.eliyon.com/NextGenSearchBot) Disallow: / User-Agent: Gaisbot/3.0+(robot@gais.cs.ccu.edu.tw;+http://gais.cs.ccu.edu.tw/robot.php) Disallow: / User-Agent: User-Agent: Mozilla/4.0 (compatible; MSIE 5.5; Windows NT 5.0) Disallow: / User-Agent: Mozilla/4.0 (compatible; MSIE 6.0; Windows NT 5.1; Hotbar wbar1.sea1-4-5-001-000.sea1.dsl-verizon.net; .NET CLR 1.0.3705) Disallow: / User-Agent: libwww-perl/5.79 Disallow: / User-Agent: Fuerza/2.1 Disallow: / User-Agent: User-Agent: Mozilla/4.07 [ja_JP.EUC] (X11; I; MarkAgent FreeBSD 2.2.8-RELEASE i386; Nav) Disallow: / User-Agent: W3CRobot Disallow: / User-Agent: W3CRobot/5.4.0 libwww/5.4.0 Disallow: / User-Agent: Mozilla/4.0 (compatible;) Disallow: / User-Agent: msnbot/0.3 (+http://search.msn.com/msnbot.htm) Disallow: / User-Agent: Mozilla/4.0 (compatible; MSIE 5.0; Windows NT; Girafabot; girafabot at girafa dot com; http://www.girafa.com) Disallow: / User-Agent: e-SocietyRobot(http://www.yama.info.waseda.ac.jp/~yamana/es/) Disallow: / User-Agent: Mozilla/4.0 (compatible; Trend Micro tmdr 1.0-1059) Disallow: / User-Agent: Mozilla/4.0 (compatible; MSIE 5.5; Windows 98; Win 9x 4.90; MSIECrawler) Disallow: / User-Agent: Mozilla/4.0 (compatible; MSIE 6.0; Windows NT 5.1; SV1; MSIECrawler) Disallow: / User-Agent: NG/2.0 Disallow: / User-Agent: Mozilla/4.0 compatible ZyBorg/1.0 Dead Link Checker (wn.dlc@looksmart.net; http://www.WISEnutbot.com) Disallow: / User-Agent: Scooter/3.3Y!CrawlX Disallow: / User-Agent: ScSpider/0.2 Disallow: / User-Agent: Mozilla/5.0 (compatible; RISA-1972 archives ; http://www.risa-1972.net/) Disallow: / User-Agent: Mozilla/4.0 (compatible; MSIE 6.0; Windows NT 5.1; (R1 1.3); MSIECrawler) Disallow: / User-Agent: TurnitinBot/2.0 http://www.turnitin.com/robot/crawlerinfo.html Disallow: / User-Agent: Scooter/3.3Y!CrawlX Disallow: / User-Agent: Jetbot/1.0 Disallow: / User-Agent: IEFav172Free Disallow: / User-Agent: Mozilla/3.0 (Planetweb/v1.54; SPS JP) Disallow: / User-Agent: Mozilla/4.0 (compatible; GoogleToolbar 2.0.112-big; Windows XP 5.1) Disallow: / User-Agent: Gigabot/2.0 Disallow: / User-Agent: GetHTTPDocument() Disallow: / User-Agent: Tutorial Crawler 1.4 (http://www.tutorgig.com/crawler) Disallow: / User-Agent: Drip Disallow: / User-Agent: Sleipnir Disallow: / User-Agent: Sleipnir Version 1.56 Disallow: / User-Agent: WebDL Disallow: / User-Agent: Pockey-GetHTML/4.12.0 (Win32; GUI; ix86) Disallow: / User-Agent: Website Explorer/0.9.6 Disallow: / User-Agent: Mozilla/4.0 compatible ZyBorg/1.0 (wn-1.zyborg@looksmart.net; http://www.WISEnutbot.com) Disallow: / User-Agent: Progressive Download Disallow: / User-Agent: Mozilla/4.0 (PDA; SL-B500/1.0,Embedix/Qtopia/1.2.1) NetFront/3.0 Disallow: / User-Agent: mxyz/1.0 Disallow: / User-Agent: Mozilla/5.0 (compatible; MSIE 6.0; Windows 98; colun's Http-Socket class 3.0 for C++) Disallow: / User-Agent: Mozilla/2.0 (compatible; Ask Jeeves/Teoma) Disallow: / User-Agent: Openbot/3.0+(robot-response@openfind.com.tw;+http://www.openfind.com.tw/robot.html) Disallow: / User-Agent: Openbot/3.0+(robot@monkia.com.tw;+http://gais.cs.ccu.edu.tw/robot.php) Disallow: / User-Agent: Wotbox/alpha0.6 (bot@wotbox.com; http://www.wotbox.com) Disallow: / User-Agent: Steeler/2.0 (http://www.tkl.iis.u-tokyo.ac.jp/~crawler/) Disallow: / User-Agent: DLC/0.55 Disallow: / User-Agent: NaverBot-1.0 (NHN Corp. / +82-2-3011-1954 / nhnbot@naver.com) Disallow: / User-agent: searchpreview Disallow: / User-Agent: Baiduspider+(+http://www.baidu.com/search/spider.htm) Disallow: / User-Agent: Mozilla/4.0 (compatible; Arachmo) Disallow: / User-Agent: Mozilla/4.0 (compatible; MSIE 6.0; Windows NT 5.1; Headline-Reader) Disallow: / User-Agent: dsdl687 Disallow: / User-Agent: dsdl214 Disallow: / User-Agent: dsdl689 Disallow: / User-Agent: dsdl212 Disallow: / User-Agent: dsdl210 Disallow: / User-Agent: MyApp Disallow: / User-Agent: Mozilla/5.0 (compatible; MSIE 6.0; Windows 98; colun's Http-Socket class 3.0 for C++) Disallow: / User-Agent: Mozilla/4.07 [ja_JP.EUC] (X11; I; FreeBSD 2.2.8-RELEASE i386; Nav) Disallow: / User-Agent: User-Agent: Mozilla/4.07 [ja_JP.EUC] (X11; I; FreeBSD 2.2.8-RELEASE i386; Nav) Disallow: / User-Agent: HTML Get Disallow: / User-Agent: Mozilla/4.0 (compatible; MSIE 6.0; Windows 98; YComp 5.0.0.0; SYMPA) Disallow: / User-Agent: livedoorCheckers/0.11 Disallow: / User-Agent: MailSearch Disallow: / User-Agent: Googlebot/Test (+http://www.googlebot.com/bot.html) Disallow: / User-Agent: Tkensaku/1.0 (http://www.tkensaku.com/q.html) Disallow: / User-Agent: Web-Crawler Disallow: / User-Agent: DownloadSpider/1.0 Disallow: / User-Agent: Gaisbot/3.0+(robot@gais.cs.ccu.edu.tw;+http://gais.cs.ccu.edu.tw/robot.php) Disallow: / User-Agent: httpunit/1.4 Disallow: / User-Agent: Mediapartners-Google/2.1 Disallow: / User-Agent: mapweb Disallow: / User-Agent: mapweb/1.0 Disallow: / User-Agent: WebStripper Disallow: / User-Agent: DLC/0.55 Disallow: / User-Agent: Mozilla/5.0 (compatible; Yahoo! Slurp; http://help.yahoo.com/help/us/ysearch/slurp) Disallow: / User-Agent: FAST-WebCrawler/3.8 (crawler at trd dot overture dot com; http://www.alltheweb.com/help/webmaster/crawler) Disallow: / User-Agent: Java/1.4.2_02 Disallow: / User-Agent: Web-Crawler Disallow: / User-Agent: BMChecker Disallow: / User-Agent: msnbot/0.11 (+http://search.msn.com/msnbot.htm) Disallow: / User-Agent: Yahoo-VerticalCrawler-FormerWebCrawler/3.9 crawler at trd dot overture dot com; http://www.alltheweb.com/help/webmaster/crawler Disallow: / User-Agent: Mozilla/5.0 (compatible; Yahoo! Slurp; http://help.yahoo.com/help/us/ysearch/slurp) Disallow: / User-Agent: Mozilla/4.0 (compatible; MSIE 6.0; Windows 98; Supplied by blueyonder) Disallow: / User-Agent: Mozilla/4.07 [ja_JP.EUC] (X11; I; FreeBSD 2.2.8-RELEASE i386; Nav) Disallow: / User-Agent: LWP::Simple Disallow: / User-Agent: LWP::Simple/5.63 Disallow: / User-Agent: Hatena Antenna/0.4 (http://a.hatena.ne.jp/help#robot) Disallow: / User-Agent: Mozilla/4.0 (compatible; MSIE 5.0; Windows NT; Girafabot; girafabot at girafa dot com; http://www.girafa.com) Disallow: / User-Agent: UP.Browser/3.04-KC15 UP.Link/3.4.5.6 Disallow: / User-Agent: WebAuto Disallow: / User-Agent: Mozilla/3.0 AVE-Front/2.6 (BrowserInfo Screen=624x400x16M; InputMethod=CONTROLER, MOUSE, REMOCON; Page=10M; Category=GAME; Product=ACCESS/NFPS; HTML-Level=3.2; Strage=NO;) Disallow: / User-Agent: Space Bison/0.02 [fu] (Win67; X; SK) Disallow: / User-Agent: FAST-WebCrawler/3.8 (crawler at trd dot overture dot com; http://www.alltheweb.com/help/webmaster/crawler) Disallow: / User-Agent: websphinx.Crawler Disallow: / User-Agent: CyberSpyder Link Test Disallow: / User-Agent: CyberSpider Disallow: / User-Agent: Csice-Agent Disallow: / User-Agent: Crawl_Application Disallow: / User-Agent: Cowbot-0.1 (NHN Corp. / +82-2-3011-1954 / nhnbot@naver.com) Disallow: / User-Agent: Computer_and_Automation_Research_Institute_Crawler Disallow: / User-Agent: Cherry Disallow: / User-Agent: Checkerlibwww-perl Disallow: / User-Agent: Checkbot Disallow: / User-Agent: Charlotte/2.00 (charlotte2@tinami.com; http://charlotte.tinami.com/robot.html) Disallow: / User-Agent: ChannelCrawler Disallow: / User-Agent: ChannelCrawler (compatible; MSIE 3.0B; Windows NT) Disallow: / User-Agent: Central Intelligence Agency Disallow: / User-Agent: Caramel.SmartSpider Disallow: / User-Agent: CXHTTP Disallow: / User-Agent: CWAD Disallow: / User-Agent: COAST WebMaster/3.0 (Windows NT) Disallow: / User-Agent: CERN-LineMode Disallow: / User-Agent: CEIS/toCrawl/UrlDispatcher Disallow: / User-Agent: CBWebSiteGW Disallow: / User-Agent: Buscaplus Robi/1.0 (http://www.buscaplus.com/robi/) Disallow: / User-Agent: BunnySlippers Disallow: / User-Agent: Bugzilla Disallow: / User-Agent: BugBrowser Disallow: / User-Agent: Bobby Disallow: / User-Agent: Bobby/4.0.1 RPT-HTTPClient/0.3-3E Disallow: / User-Agent: Bobby/3.3 RPT-HTTPClient/0.3-3E Disallow: / User-Agent: BlackClay Disallow: / User-Agent: Binetx Disallow: / User-Agent: Big Brother (http://pauillac.inria.fr/~fpottier/) Disallow: / User-Agent: Being Browser Disallow: / User-Agent: Being Browser ver1.34 Disallow: / User-Agent: BeeDrop Disallow: / User-Agent: BeeDrop/1.2.0 Disallow: / User-Agent: BaiDuSpider Disallow: / User-Agent: BSpider Disallow: / User-Agent: BSpider/1.0 Disallow: / User-Agent: BLT(LinkChecker0.2) Disallow: / User-Agent: BMChecker Disallow: / User-Agent: Astra/2.0 (WinNT; I) Disallow: / User-Agent: Aspects Crawler Disallow: / User-Agent: Arrangebot Disallow: / User-Agent: ASPSeek Disallow: / User-Agent: ARIENAI/1.1 (compatible; MSIE 6.0; GEOcide) Disallow: / User-Agent: Arjuna/1.0 Disallow: / User-Agent: Ariadna/1.2 beta 1 (WinNT; I; E; B; Oct 4 1996) Disallow: / User-Agent: ArchitextSpider Disallow: / User-Agent: Aqua Sphere Explorer Disallow: / User-Agent: Another_HTML-lint Disallow: / User-Agent: AnswerBus (http://www.answerbus.com/) Disallow: / User-Agent: Anarchie/3.0 Disallow: / User-Agent: Analogue Bubbletoms Disallow: / User-Agent: AnalogX Proxy 4.01 (www.analogx.com) Disallow: / User-Agent: Acme.Spider Disallow: / User-Agent: Adobe Acrobat Disallow: / User-Agent: AgentName/0.1 libwww-perl/5.48 Disallow: / User-Agent: AgentNamelibwww-perl Disallow: / User-Agent: AgentNamelibwww-perl/5.69 Disallow: / User-Agent: Green Research, Inc. Disallow: / User-Agent: http://www.almaden.ibm.com/cs/crawler Disallow: / User-agent: http://www.almaden.ibm.com/cs/crawler [c01] Disallow: / User-Agent: NPBot (http://www.nameprotect.com/botinfo.html) Disallow: / User-Agent: MFC_Tear_Sample Disallow: / User-Agent: surfingFOLiO Disallow: / User-Agent: WebTrans Disallow: / User-Agent: WebCopier v4.0 Disallow: / User-Agent: WebCopier Disallow: / User-Agent: Mediapartners-Google/2.1 (+http://www.googlebot.com/bot.html) Disallow: / User-Agent: Microsoft Data Access Internet Publishing Provider Protocol Discovery Disallow: / User-Agent: Mozilla/3.0 (compatible; Indy Library) Disallow: / User-Agent: FAST-WebCrawler/3.8 (crawler at trd dot overture dot com; http://www.alltheweb.com/help/webmaster/crawler) Disallow: / User-Agent: Mozilla/4.0 (compatible; Cerberian Drtrs Version-3.0-Build-41) Disallow: / User-Agent: surfingFOLiO Disallow: / User-Agent: WeBoX Disallow: / User-Agent: Internet Ninja 5.0 Disallow: / User-Agent: iCab J Disallow: / User-Agent: Mozilla/4.0 (compatible; MSIE 5.0; Windows NT; Girafabot; girafabot at girafa dot com; http://www.girafa.com) Disallow: / User-Agent: User-Agent: Mozilla/4.07 [ja_JP.EUC] (X11; I; FreeBSD 2.2.8-RELEASE i386; Nav) Disallow: / User-Agent: Mozilla/4.07 [ja_JP.EUC] (X11; I; FreeBSD 2.2.8-RELEASE i386; Nav) Disallow: / User-Agent: SpaceBison/0.01 [fu] (Win67; X; ShonenKnife) Disallow: / User-Agent: Mozilla/4.0 (compatible; MSIE 6.0; Windows 98; \xbe\xdc\xc6\xc4\xc0\xcf (atfile.com)) Disallow: / User-Agent: Pockey-GetHTML Disallow: / User-Agent: Pockey-GetHTML/4.12.0 (Win32; GUI; ix86) Disallow: / User-Agent: Sleipnir Version 1.41 Disallow: / User-Agent: Sleipnir Version 1.42 Disallow: / User-Agent: Mozilla/4.0 (compatible; Spider) Disallow: / User-Agent: msnbot Disallow: / User-Agent: BravoBrian BStop Disallow: / User-Agent: Space Bison/0.02 [fu] (Win67; X; SK) Disallow: / User-Agent: Space Bison Disallow: / User-Agent: Safari Disallow: / User-Agent: Green Research, Inc. Disallow: / User-Agent: Mozilla/4.0;CBBoard-1.0 Disallow: / User-Agent: FAST-WebCrawler/3.8 (crawler at trd dot overture dot com; http://www.alltheweb.com/help/webmaster/crawler) Disallow: / User-Agent: TurnitinBot?/1.5 Disallow: / User-Agent: TurnitinBot Disallow: / User-Agent: Steeler/1.3 (http://www.tkl.iis.u-tokyo.ac.jp/~crawler/) Disallow: / User-Agent: WebZIP Disallow: / User-Agent: WebGo IS Disallow: / User-Agent: WebGo IS - 2084 Disallow: / User-Agent: BravoBrian SpiderEngine MarcoPolo Disallow: / User-Agent: Mozilla/4.0 (compatible; MSIE 5.0; Windows NT; DigExt; DTS Agent Disallow: / User-agent: Whizbang Disallow: / User-agent: nabot Disallow: / User-Agent: ArchitextSpider Disallow: / User-agent: DiaGem Disallow: / User-agent: SlySearch Disallow: / User-Agent: sitecheck.internetseer.com Disallow: / User-agent: Scooter Disallow: / User-agent: bumblebee Disallow: / User-agent: BravoBrian SpiderEngine MarcoPolo Disallow: / User-agent: http://www.almaden.ibm.com/cs/crawler Disallow: / User-agent: TurnitinBot Disallow: / User-agent: vspider Disallow: / User-agent: dloader Disallow: / User-agent: minibot Disallow: / User-agent: Steeler Disallow: / User-Agent: HTML Get Disallow: / User-Agent: Mozilla/4.0 (compatible; MSIE 6.0; Windows NT 5.1; .NET CLR 1.1.4322; MSIECrawler) Disallow: / User-Agent: Mozilla/4.0 compatible ZyBorg/1.0 Dead Link Checker (wn.zyborg@looksmart.net; http://www.WISEnutbot.com) Disallow: / User-Agent: WebSauger 1.20i Disallow: / User-Agent: AgentNamelibwww-perl/5.69 Disallow: / User-Agent: Baiduspider+ Disallow: / User-Agent: Bloglines/1.0 Disallow: / User-Agent: Iria/1.07a Disallow: / User-Agent: Irvine/1.0.3b Disallow: / User-Agent: Nutscrape/1.0 (CP/M; 8-bit) Disallow: / User-Agent: Openfind data gatherer, Openbot/3.0+ Disallow: / User-Agent: Mozilla/4.0 (compatible; PerMan Surfer 3.0; ) Disallow: / User-Agent: yahoo-fetch Disallow: / User-Agent: WebCrawler-AddURL/1.0 Disallow: / User-Agent: W3CLineMode/5.0a libwww/5.0a Disallow: / User-Agent: Rcaau/1.1 Disallow: / User-Agent: Wapibot Disallow: / User-Agent: msnbot Disallow: / User-Agent: Cowbot-0.1.1 (NHN Corp. / +82-2-3011-1954 / nhnbot@naver.com) Disallow: / User-Agent: MCUPDATE Disallow: / User-Agent: Industry Update Control Disallow: / User-Agent: WebGo IS - 1784 Disallow: / User-Agent: w3m/0.4.1-m17n-20030308 Disallow: / User-Agent: Sleipnir Disallow: / User-Agent: CMC/0.01 Disallow: / User-Agent: Bookmark Renewal Check Agent Disallow: / User-Agent: Bookmark Renewal Check Agent [http://www.bookmark.ne.jp/] (Version 2.0beta) Disallow: / User-Agent: Googlebot-Image Disallow: / User-Agent: Hatena Antenna Disallow: / User-Agent: Pockey-GetHTML/4.11.6 (Win32; GUI; ix86) Disallow: / User-Agent: Mozilla/4.0 (compatible; MSIE 6.0; Windows NT 5.0; .NET CLR 1.0.3705) (via translate.google.com) Disallow: / User-Agent: Nogate Disallow: / User-Agent: SakeBot Disallow: / User-Agent: Cowbot-0.1 (NHN Corp. / +82-2-3011-1954 / nhnbot@naver.com) Disallow: / User-Agent: Mozilla/4.0 (compatible; GoogleToolbar 1.1.62-big; Windows 2000 5.0) Disallow: / User-Agent: Sleipnir Version 1.30 beta4 Disallow: / User-Agent: CerberianDrtrs/Version-3.0-Build-30 Disallow: / User-Agent: i-modeconverter Disallow: / User-Agent: VCI WebViewer VCI WebViewer Win32 Disallow: / User-Agent: iSiloX/4.0 Windows/32 Disallow: / User-Agent: AgentNamelibwww-perl/5.69 Disallow: / User-Agent: URL Check Program Disallow: / User-Agent: Mozilla/4.0 (compatible; Spider) Disallow: / User-Agent: NPBot Disallow: / User-Agent: Java 1.1 Disallow: / User-Agent: Program Shareware 1.0.3 Disallow: / User-Agent: Mozilla/4.0 (compatible; MSIE 6.0; Windows NT 5.0; FunWebProducts; .NET CLR 1.1.4322) Disallow: / User-Agent: Mozilla/4.0 (compatible; MSIE 6.0; Windows NT 5.0; DigExt; Hotbar lsanca2-ar33-4-3-005-000.lsanca2.dsl-verizon.net; .NET CLR 1.0.3705; .NET CLR 1.1.4322) Disallow: / User-Agent: Aruyo/0.01 (http://www.aaacafe.ne.jp/ ;postmaster@aaacafe.ne.jp) Disallow: / User-Agent: Mozilla/4.0 (compatible; PerMan Surfer 3.0; ) Disallow: / User-Agent: Mozilla/4.0 (compatible; MSIE 5.01; Windows 98; MSIECrawler) Disallow: / User-Agent: Mozilla/3.0 (compatible; WebCapture 2.0; Windows) Disallow: / User-Agent: Mozilla/4.0 (compatible; MSIE 6.0; Windows NT 5.0; Hotbar lsanca2-ar33-4-3-005-000.lsanca2.dsl-verizon.net; .NET CLR 1.1.4322) Disallow: / User-Agent: Mozilla/4.0 (compatible; MSIE 6.0; Windows NT 5.1; Alexa Toolbar) Disallow: / User-Agent: Mozilla/4.0 (compatible; MSIE 6.0; Windows NT 5.1; Hotbar lsanca2-ar33-4-3-005-000.lsanca2.dsl-verizon.net; .NET CLR 1.1.4322) Disallow: / User-Agent: Mozilla/4.76iC-CCK-MCD [ja_JP] (X11; U; AIX 4.3) Disallow: / User-Agent: Microsoft-WebDAV-MiniRedir/5.1.2600 Disallow: / User-Agent: Mozilla/4.0 (compatible; MSIE 6.0; Windows NT 5.1; MSIECrawler) Disallow: / User-Agent: Mozilla/4.0 (compatible; MSIE 6.0; Windows NT 5.1; Q312461; MSIECrawler) Disallow: / User-Agent: psbot/0.1 (+http://www.picsearch.com/bot.html) Disallow: / User-Agent: Imozuru/1.0 Disallow: / User-Agent: Mozilla/3.0 (PNWalker/2.0.0) Disallow: / User-Agent: Space Bison/0.02 [fu] (Win67; X; SK) Disallow: / User-Agent: Mozilla/5.0 (compatible; MSIE 6.0; Windows 98; colun's Http-Socket class 3.0 for C++) Disallow: / User-Agent: Mozilla/4.0 (compatible; MSIE 5.0; Windows 98; 3Com U.S. Robotics Connections; DigExt) Disallow: / User-Agent: Mozilla/4.0 (compatible; MSIE 6.0; Windows NT 5.1; Hotbar lsanca2-ar33-4-3-005-000.lsanca2.dsl-verizon.net) Disallow: / User-Agent: Gator/4.1 Disallow: / User-Agent: WEP Search 00 Disallow: / User-Agent: IEFav172Free Disallow: / User-agent: DiaGem Disallow: / User-agent: Blocked by Norton Disallow: / User-agent: nabot Disallow: / User-Agent: sitecheck.internetseer.com Disallow: / User-Agent: Jabot/7.2.3 (http://odin.ingrid.org/) Disallow: / User-Agent: Openbot Disallow: / User-Agent: PureSight Disallow: / User-agent: mogimogi Disallow: / User-Agent: Googlebot Disallow: / User-agent: girafa Disallow: / User-agent: Steeler Disallow: / User-agent: TurnitinBot Disallow: / User-agent: WWWC/1.00 Disallow: / User-agent: WWWC/1.04 Disallow: / User-agent: WWWC/0.24 Disallow: / User-agent: InfoSeek Disallow: / User-agent: InfoSeek Sidewinder Disallow: / User-agent: InfoSeek Sidewinder/2.0B (Linux 2.4 i686) Disallow: / User-agent: InfoSeek Sidewinder/0.9 Disallow: / User-agent: Infoseek SideWinder/1.1A Disallow: / User-agent: Infoseek SideWinder/1.4 (Compatible; MSIE 10.0; UNIX) Disallow: / User-agent: Infoseek SideWinder/1.45 (Compatible; MSIE 10.0; UNIX) Disallow: / User-agent: ArchitextSpider Disallow: / User-agent: Netscape-Catalog-Robot Disallow: / User-agent: W3CRobot/4.0D Disallow: / User-agent: MOMspider/1.00 libwww-perl/0.40 Disallow: / User-agent: libwww-perl Disallow: / User-agent: libwww-perl/5.02 Disallow: / User-agent: libwww-perl/5.48 Disallow: / User-agent: iSpi/2.0 Disallow: / User-agent: NetRecorder/1.0 Disallow: / User-agent: InternetLinkAgent/3.1 Disallow: / User-agent: indexpert/2.0 Disallow: / User-agent: gazz/2.1 Disallow: / User-agent: Robot/www.pj-search.com Disallow: / User-agent: WebAuto/3.40 Disallow: / User-agent: Pockey-GetHTML/4.11.4 Disallow: / User-agent: MailSpider Disallow: / User-agent: ia_archiver Disallow: / User-agent: Csice-Agent Disallow: / User-agent: HyperRobot Disallow: / User-agent: Mercator-2.0 Disallow: / User-agent: Scooter/1.0 Disallow: / User-agent: Scooter/3.2 Disallow: / User-agent: Scooter/3.3 Disallow: / User-agent: minibot Disallow: / User-agent: Hatena Antenna/0.3 Disallow: / User-agent: Mozilla/4.0 compatible ZyBorg/1.0 (wn.zyborg@looksmart.net; http://www.WISEnutbot.com) Disallow: / User-agent: mogimogi/1.0 Disallow: / User-agent: moget/2.1 (moget@goo.ne.jp) Disallow: / User-agent: FreshGet/4.0 Disallow: / User-agent: indexpert/2.0 Disallow: / User-agent: Mozilla/3.0 (aruyo/0.01;http://www.aaacafe.ne.jp/ ;support@aaacafe.ne.jp) Disallow: / User-agent: Down Site Checker V2.0 Disallow: / User-agent: Mozilla/3.0 (compatible; Indy Library) Disallow: / User-agent: ArchitextSpider Disallow: / User-agent: Lycos_Spider_(T-Rex) Disallow: / User-agent: nttdirectory_robot/0.9 Disallow: / User-agent: InfoNaviRobot(F104) Disallow: / User-agent: Sleipnir Version 1.40 beta7 Disallow: / User-agent: Sleipnir Version 1.41 Disallow: / User-agent: Sleipnir Version 1.40 beta3 Disallow: / User-agent: Cuam Ver0.050bx Disallow: / User-agent: WebPatrol/1.0 OS X Disallow: / User-agent: WebPatrol/1.0 Disallow: / User-agent: yukikaze/3.0 Disallow: / User-agent: dloader(NaverRobot)/1.0 Disallow: / User-agent: dloader(NaverRobot)/1.5 Disallow: / User-agent: UP.Browser/3.04-MA13 UP.Link/3.4.5.6 Disallow: / User-agent: UP.Browser/3.04-MA12 UP.Link/3.4.5.6 Disallow: / User-agent: WebFetch Disallow: / User-agent: Jabot/7.0.7 (http://odin.ingrid.org/) Disallow: / User-agent: Jabot/7.0.6 Disallow: / User-agent: Steeler/1.3 (http://www.tkl.iis.u-tokyo.ac.jp/~crawler/) Disallow: / User-agent: TurnitinBot/1.5 http://www.turnitin.com/robot/crawlerinfo.html Disallow: / User-agent: http_get Disallow: / User-agent: RMA/1.0 (compatible; RealMedia) Disallow: / User-agent: Mozilla/2.0 (compatible; Ask Jeeves) Disallow: / User-agent: Internet Ninja 5.0 Disallow: / User-agent: Internet Ninja 6.0 Disallow: / User-agent: Download Ninja 7.0 Disallow: / User-agent: toCrawl/UrlDispatcher Disallow: / User-agent: Steeler/1.3 (http://www.tkl.iis.u-tokyo.ac.jp/~crawler/) Disallow: / User-agent: Mozilla/4.0 efp@gmx.net Disallow: / User-agent: Mozilla/3.01 (compatible;) Disallow: / User-agent: Mozilla/4.0 (compatible; MSIE 5.0; Windows NT; DigExt; DTS Agent Disallow: / User-agent: Scooter-ARS-1.1 Disallow: / User-agent: libwww-perl/5.53 Disallow: / User-agent: Mozilla/5.0 Galeon/1.2.6 (X11; Linux i686; U;) Gecko/20020922 Disallow: / User-agent: Java(TM) 2 Runtime Environment, Standard Edition Disallow: / User-agent: Windows Update Disallow: / User-agent: CryptRetrieveObjectByUrl::InetSchemeProvider Disallow: / User-agent: WebTrans Disallow: / User-agent: Mozilla/4.0 (compatible; grub-client-1.0.7; Crawl your own stuff with http://grub.org) Disallow: / User-agent: Mozilla/4.0 (compatible; grub-client-1.2.1; Crawl your own stuff with http://grub.org) Disallow: / User-agent: Wget/1.5.3 Disallow: / User-agent: Wget/1.8.2 Disallow: / User-agent: DoCoMo/1.0/P502i/c10 (Google CHTML Proxy/1.0) Disallow: / User-agent: Mozilla/5.0 (Slurp/cat; slurp@inktomi.com; http://www.inktomi.com/slurp.html) Disallow: / User-agent: CCU;MSIE Disallow: / User-agent: Googlebot/2.1 (+http://www.googlebot.com/bot.html) Disallow: / User-agent: Gaisbot/3.0+(robot@gais.cs.ccu.edu.tw;+http://gais.cs.ccu.edu.tw/robot.php) Disallow: / User-agent: Openfind data gatherer, Openbot/3.0+(robot-response@openfind.com.tw;+http://www.openfind.com.tw/robot.html) Disallow: / User-agent: DoCoMo/2.0 P2101V(c100) Disallow: / User-agent: TMhtload/1.31.00.1717 Disallow: / User-agent: Mozilla/4.0 (compatible; grub-client-1.1.1; Crawl your own stuff with http://grub.org) Disallow: / User-agent: LinkSonar/1.35 Disallow: / User-agent: Mozilla/4.0 (compatible; grub-client-1.0.5; Crawl your own stuff with http://grub.org) Disallow: / User-agent: Openfind data gatherer, Openbot/3.x+(robot-response@openfind.com.tw;+http://www.openfind.com.tw/robot.html) Disallow: / User-agent: Sleipnir Disallow: / User-agent: FAST-WebCrawler/3.x (atw-crawler at fast dot no; http://fast.no/support/crawler.asp) Disallow: / User-agent: FAST-RealWebCrawler/3.8 (crawler@fast.no; http://fast.no/support/crawler.asp) Disallow: / User-agent: Steeler/1.x (http://www.tkl.iis.u-tokyo.ac.jp/~crawler/) Disallow: / User-agent: Scooter/3.x Disallow: / User-agent: moget/2.x (moget@goo.ne.jp) Disallow: / User-agent: Mozilla/5.0 (compatible; Konqueror/2.1.2; X11) Disallow: / User-agent: FAST-WebCrawler/3.8 (atw-crawler at fast dot no; http://fast.no/support/crawler.asp) Disallow: / User-agent: FAST-WebCrawler/3.6 (atw-crawler at fast dot no; http://fast.no/support/crawler.asp) Disallow: / User-agent: Microsoft Data Access Internet Publishing Provider Protocol Discovery Disallow: / User-agent: Microsoft URL Control - 6.00.8862 Disallow: / User-agent: Microsoft URL Control - 6.00.8169 Disallow: / User-Agent: Mozilla/4.0 (compatible; MSIE 5.5; Windows 98; \xbe\xc6\xc6\xae\xb9\xcc\xb5\xf0\xbe\xee (artmedia.org); .NET CLR 1.0.3705) Disallow: / User-agent: DLC/0.55 Disallow: / User-Agent: Mozilla/4.0 (compatible; MSIE 6.0; Windows NT 5.1; MSN 6.1; MSNbMSFT; MSNmko-kr; MSNc00; v5m) Disallow: / User-Agent: PlantyNet_WebRobot_V1.9 dhkang@plantynet.com Disallow: / User-agent: WireAction URLCheckSpider Disallow: / User-agent: Mozilla/4.0 (compatible; grub-client-1.3.7; Crawl your own stuff with http://grub.org) Disallow: / User-agent: Webshuttle Disallow: / User-agent: FAST-WebCrawler/3.7/FirstPage (atw-crawler at fast dot no;http://fast.no/support/crawler.asp) Disallow: / User-agent: Charlotte/2.00 (charlotte2@tinami.com; http://charlotte.tinami.com/robot.html) Disallow: / User-agent: Mozilla/4.0 (compatible; MSIE 6.0; Windows 98; Win 9x 4.90; SEARCHALOT IE6) Disallow: / User-Agent: Mozilla/4.0 (compatible; MSIE 6.0; Windows 98; Win 9x 4.90; .NET CLR 1.0.3705; Alexa Toolbar) Disallow: / User-Agent: Mozilla/4.0 (compatible; MSIE 6.0; Windows NT 5.1; Alexa Toolbar) Disallow: / User-Agent: Mozilla/3.0 (compatible; Indy Library) Disallow: / User-agent: Mozilla/3.0 KOMATSU (AveFront/2.6 WebLight) WL/3.0 V2.45ohi M=11E2A2499B6D Disallow: /