CrawlerPulse
CrawlerPulse / Europe / Russia / communa.ru

communa.ru

communa.ru · Russia · measured 8 Oct 2026

Google Search
Allowed
Google-Extended
Allowed
OpenAI
Allowed
Anthropic
Allowed
Perplexity
Allowed
Meta
Allowed
Common Crawl
Allowed
ByteDance
Allowed
Apple
Allowed
Amazon
Allowed

robots.txt

As read on 8 Oct 2026, 1,182 bytes. No rule names an AI crawler.

User-agent: *
Host: https://communa.ru
Disallow: */index.php
Disallow: /bitrix/
Disallow: /*show_include_exec_time=
Disallow: /*show_page_exec_time=
Disallow: /*show_sql_stat=
Disallow: /*bitrix_include_areas=
Disallow: /*clear_cache=
Disallow: /*clear_cache_session=
Disallow: /*ADD_TO_COMPARE_LIST
Disallow: /*ORDER_BY
Disallow: /*?print=
Disallow: /*&print=
Disallow: /*print_course=
Disallow: /*?action=
Disallow: /*&action=
Disallow: /*register=
Disallow: /*forgot_password=
Disallow: /*change_password=
Disallow: /*login=
Disallow: /*logout=
Disallow: /*auth=
Disallow: /*backurl=
Disallow: /*back_url=
Disallow: /*BACKURL=
Disallow: /*BACK_URL=
Disallow: /*back_url_admin=
Disallow: /*?utm_source=
Disallow: /*_openstat
Disallow: /*from=adwords
Disallow: /*utm_source
Disallow: /*geo/
Disallow: /*spec/
Disallow: /search/*
Disallow: /*printform/
Disallow: /cart/
Disallow: *.doc
Disallow: /*?sort_by_field
Disallow: /*?id=
Disallow: /test-main-page/
Disallow: /templates/
Disallow: /hostcmsfiles/
Disallow: /yasearch/
Disallow: /options/
Disallow: /cart_hid/
Disallow: /404/
Disallow: /503/
Disallow: /403/
Disallow: /admin/
Disallow: /*?power_
Disallow: /*function.require/

History

Changes recorded since June 2026.

No change recorded.

In context

Russia
6.3% block at least one AI crawler
Behind Cloudflare
No