User-agent: * Disallow: /en/img User-agent: * Disallow: /en/css User-agent: * Disallow: /jp/img User-agent: * Disallow: /jp/css User-Agent: GoForIt.com Disallow: / User-agent: Baiduspider+ Disallow: / User-agent: Baiduspider+(+http://www.baidu.com/search/spider.htm) Disallow: / User-agent: MJ12bot Disallow: / User-agent: ia_archiver Disallow: / User-Agent: Googlebot-Image Disallow: / User-agent: ::_detectURL Disallow: / User-agent: MVAClient Disallow: / User-agent: Openbot Disallow: / User-agent: http://www.almaden.ibm.com/cs/crawler Disallow: / User-agent: Gaisbot/3.0+(robot@gais.cs.ccu.edu.tw;+http://gais.cs.ccu.edu.tw/robot.php) Disallow: / User-Agent: fast Disallow: / User-agent: Openfind data gatherer Disallow: / User-agent: Scooter/3.3 Disallow: / User-agent: buildrack93.sv.av.com Disallow: / User-agent: PlantyNet_WebRobot_V1.9 dhkang@plantynet.com Disallow: / User-agent: kuloko-bot/0.2 Disallow: / User-agent: searchpreview Disallow: / User-agent: NABOT/5.0 Disallow: / User-agent: NaverBot-1.0 Disallow: / User-agent: Cowbot* Disallow: / User-agent: sohu-search Disallow: / User-agent: Cowbot-0.1.1 Disallow: / User-agent: IconSurf Disallow: /favicon.ico