User-agent: * Disallow: /ws Disallow: /upload Disallow: /tpl Disallow: /tools Disallow: /rus1 Disallow: /pmexpert Disallow: /pm-stars Disallow: /personal Disallow: /news Disallow: /new Disallow: /mtest1_files Disallow: /dl Disallow: /images Disallow: /config Disallow: /cgi-bin Disallow: /bitrix Disallow: /admin Sitemap: http://www.itexpert.ru/sitemap.xml.gz User-agent: Yandex Disallow: /ws Disallow: /upload Disallow: /tpl Disallow: /tools Disallow: /rus1 Disallow: /pmexpert Disallow: /pm-stars Disallow: /personal Disallow: /news Disallow: /new Disallow: /mtest1_files Disallow: /config Disallow: /cgi-bin Disallow: /bitrix Disallow: /admin Crawl-delay: 10 Host: www.itexpert.ru User-agent: Googlebot Disallow: /ws Disallow: /upload Disallow: /tpl Disallow: /tools Disallow: /rus1 Disallow: /pmexpert Disallow: /pm-stars Disallow: /personal Disallow: /news Disallow: /new Disallow: /mtest1_files Disallow: /config Disallow: /cgi-bin Disallow: /bitrix Disallow: /admin User-agent: StackRambler Disallow: /ws Disallow: /upload Disallow: /tpl Disallow: /tools Disallow: /rus1 Disallow: /pmexpert Disallow: /pm-stars Disallow: /personal Disallow: /news Disallow: /new Disallow: /mtest1_files Disallow: /config Disallow: /cgi-bin Disallow: /bitrix Disallow: /admin User-agent: Slurp Crawl-delay: 10 Disallow: /ws Disallow: /upload Disallow: /tpl Disallow: /tools Disallow: /rus1 Disallow: /pmexpert Disallow: /pm-stars Disallow: /personal Disallow: /news Disallow: /new Disallow: /mtest1_files Disallow: /config Disallow: /cgi-bin Disallow: /bitrix Disallow: /admin User-agent: MSNBot Disallow: /ws Disallow: /upload Disallow: /tpl Disallow: /tools Disallow: /rus1 Disallow: /pmexpert Disallow: /pm-stars Disallow: /personal Disallow: /news Disallow: /new Disallow: /mtest1_files Disallow: /config Disallow: /cgi-bin Disallow: /bitrix Disallow: /admin User-agent: msnbot-news Disallow: /ws Disallow: /upload Disallow: /tpl Disallow: /tools Disallow: /rus1 Disallow: /pmexpert Disallow: /pm-stars Disallow: /personal Disallow: /news Disallow: /new Disallow: /mtest1_files Disallow: /config Disallow: /cgi-bin Disallow: /bitrix Disallow: /admin User-agent: msnbot-MM Disallow: /ws Disallow: /upload Disallow: /tpl Disallow: /tools Disallow: /rus1 Disallow: /pmexpert Disallow: /pm-stars Disallow: /personal Disallow: /news Disallow: /new Disallow: /mtest1_files Disallow: /config Disallow: /cgi-bin Disallow: /bitrix Disallow: /admin User-agent: MSNBot-Academic Disallow: /ws Disallow: /upload Disallow: /tpl Disallow: /tools Disallow: /rus1 Disallow: /pmexpert Disallow: /pm-stars Disallow: /personal Disallow: /news Disallow: /new Disallow: /mtest1_files Disallow: /config Disallow: /cgi-bin Disallow: /bitrix Disallow: /admin User-Agent: turtle Disallow: /ws Disallow: /upload Disallow: /tpl Disallow: /tools Disallow: /rus1 Disallow: /pmexpert Disallow: /pm-stars Disallow: /personal Disallow: /news Disallow: /new Disallow: /mtest1_files Disallow: /config Disallow: /cgi-bin Disallow: /bitrix Disallow: /admin User-Agent: OmniExplorer_Bot/1.09 Disallow: / User-Agent: larbin_2.6.3 Disallow: / User-agent: Mediapartners-Google* Disallow: / User-agent: msnbot-products Disallow: / User-agent: Webalta Disallow: /