User-agent: * Disallow: User-agent: libwww-perl/5.803 Disallow: / User-agent: libwww-perl/5.79 Disallow: / User-agent: libwww-perl/5.76 Disallow: / User-agent: libwww-perl/5.69 Disallow: / User-agent: libwww-perl/5.65 Disallow: / User-agent: libwww-perl/5.805 Disallow: / User-agent: libwww-perl/5.73 Disallow: / User-agent: libwww-perl/5.75 Disallow: / User-agent: libwww-perl/5.79 Disallow: / User-agent: Java/1.6.0_01 Disallow: / User-agent: Java/1.6.0_03 Disallow: / User-agent: Microsoft URL Control - 6.00.8862 Disallow: / User-agent: Missigua Locator 1.9 Disallow: / User-agent: 8484 Boston Project v 1.0 Disallow: / User-agent: Mozilla/1.22 Disallow: / User-agent: Mozilla/4.0 Disallow: / User agent: Mozilla/2.0 Disallow: / User agent: Mozilla/4.5 Disallow: / User-agent: Mozilla/4.7 Webster Pro V3.4 Disallow: / User agent: Mozilla/5.0 Disallow: / User-agent: Mozilla/4.0 (compatible; MSIE 7.0b; Windows NT 6.0) Disallow: / User-agent: Mozilla/4.0(compatible; MSIE 5.0; Windows 98; DigExt) Disallow: / User-agent: Mozilla/4.0 (compatible; MSIE 6.0; Windows NT 5.1; DigExt) Disallow: / User-agent: Mozilla/4.0 (compatible; MSIE 5.0; Windows NT; DigExt) Disallow: / User-agent: Mozilla/4.0 (compatible; MSIE 6.0; Windows 98) Disallow: / User-agent: Mozilla/4.0 (compatible; MSIE 6.0; Windows NT 5.1; SV1; MRA 4.6 (build 01425); MRSPUTNIK 1, 5, 0, 19 SW) Disallow: / User-agent: Mozilla/5.0 (Windows NT 5.1; U; en) Opera 8.00 Disallow: / User-agent: Mozilla/5.0 (compatible; WebDataCentreBot/1.0; +http://WebDataCentre.com/) Disallow: / User-agent: Pingdom GIGRIB Disallow: / User-agent: MJ12bot/v1.0.8 Disallow: / User-agent: 8484 Boston Project v 1.0 Disallow: / User-agent: POE-Component-Client-HTTP/0.65 Disallow: / User-agent: http://Anonymouse.org/ Disallow: / User-agent: CFNetwork/129.22 Disallow: / User-agent: CFNetwork/4.0 Disallow: / User-agent: CFNetwork/129.22 Disallow: / User-agent: CFNetwork/221.5 Disallow: / User-agent: WEP Search 00 Disallow: / User-agent: Mozilla/4.0 (compatible; MSIE 5.5; Windows NT 4.0; obot) Disallow: / User-agent: Jakarta Commons-HttpClient/3.0.1 Disallow: / User-agent: Microsoft Data Access Internet Publishing Provider DAV 1.1 Disallow: / User-agent: Python-urllib/2.5 Disallow: / User-agent: WebAlta Crawler/2.0 (http://www.webalta.net/ru/about_webmaster.html) (Windows; U; Windows NT 5.1; ru-RU) Disallow: / User-agent: Mozilla/4.0 (compatible; MSIE 7.0; Windows NT 5.1; SpamBlockerUtility 4.8.4) Disallow: / User-agent: Mac Finder 1.0.13 Disallow: / User-agent: bot/1.0 (bot; http://; bot@bot.bot) Disallow: / User-agent: Wells Search II Disallow: / User-agent: Missouri College Browse Disallow: / User-agent: dumbot Disallow: / User-agent: Mozilla/4.0 (compatible; MSIE 4.01; Digital AlphaServer 1000A 4/233; Windows NT; Powered By 64-Bit Alpha Processor) Disallow: / User-agent: Mozilla/4.0 (compatible; MSIE 6.0; Windows NT 5.0; Avant Browser [avantbrowser.com]; Hotbar 4.4.5.0) Disallow: / User-agent: Opera/7.11 (Windows NT 5.1; U) [en] Disallow: / User-agent: Opera/8.00 (Windows NT 5.1; U; en) Disallow: / User-agent: Mozilla/4.0 (compatible; MSIE 7.0b; Windows NT 6.0 ; .NET CLR 2.0.50215; SL Commerce Client v1.0; Tablet PC 2.0 Disallow: / User-agent: Mozilla/4.79 [en] (Windows NT 5.0; U) Disallow: / User-agent: Mozilla/5.0 (compatible; MarketDefenderBot/2.0; +http://www.marketdefender.com/bot.html) Disallow: / User-agent: Casper Bot Search Disallow: / User-agent: Mozilla/5.0 (compatible; YandexBot/3.0; +http://yandex.com/bots) Disallow: / User-agent:Mozilla/4.0 (compatible; MSIE 6.0; Windows NT 5.1; SV1 + FairShare-http://fairshare.cc) Disallow: / # Begin Exclusion From Directories from robots.txt User-agent: * Disallow: /cgi-bin/ User-agent: * Disallow: /lak/lak User-agent: * Disallow: /mail_guestbook/ User-agent: Googlebot Disallow: /mail_guestbook/ User-agent: Googlebot Disallow: /_A_O_rawinput/