User-agent: *
Allow: /
Disallow: /*?rubric=
Disallow: /*&rubric=
Disallow: /suggest
Disallow: /client_search_filter
Disallow: /rss/web2
Crawl-delay: 5
Request-rate: 1/5

User-agent: Yandex
Allow: /
Disallow: /*?rubric=
Disallow: /*&rubric=
Disallow: /suggest
Disallow: /client_search_filter
Crawl-delay: 5

User-agent: Googlebot
Allow: /
Disallow: /*?rubric=
Disallow: /*&rubric=
Disallow: /suggest
Disallow: /client_search_filter

Host: www.mskagency.ru