CrawlerPulse
CrawlerPulse / Europe / Russia / ria.ru

ria.ru

ria.ru · Russia · fr.ria.ru · measured 8 Oct 2026

Google Search
Allowed
Google-Extended
Allowed
OpenAI
Allowed
Anthropic
Allowed
Perplexity
Allowed
Meta
Allowed
Common Crawl
Allowed
ByteDance
Allowed
Apple
Allowed
Amazon
Allowed

robots.txt

As read on 8 Oct 2026, 2,216 bytes. No rule names an AI crawler.

User-agent: *
Disallow: *-print.html$
Disallow: /sys_*
Disallow: /valdai/
Disallow: /search/
Disallow: /ria_70*
Disallow: /test_adfox*
Disallow: /ecokarta*
Disallow: /id/
Disallow: /cms/
Disallow: */embed/
Disallow: /specialprojects/
Disallow: /_editorial_preview_*
Disallow: /amp/*/more.html*
Disallow: /services/
Disallow: *%7B%7B*
Disallow: /*/?*
Disallow: /*/*?*
Disallow: /common_otkrytki/
Allow: /*?page=*
Allow: /*/*?page=*

User-agent: Yandex
Disallow: /amp/*
Disallow: *-print.html$
Disallow: /sys_*
Disallow: /valdai/
Disallow: /search/
Disallow: /ria_70*
Disallow: /test_adfox*
Disallow: /ecokarta*
Disallow: /id/
Disallow: */embed/
Disallow: /specialprojects/
Disallow: /_editorial_preview_*
Disallow: /services/
Disallow: *%7B%7B*
Disallow: /*/?*
Disallow: /*/*?*
Disallow: /cms/
Disallow: /common_otkrytki/
Allow: /*?page=*
Allow: /*/*?page=*
Clean-param: __twitter_impression&ues&amp
Clean-param: in /*/*html
Clean-param: rcmd_alg /*/*html
Clean-param: title_ver /
Clean-param: chat_room_id /
Clean-param: rcmd_id /
Clean-param: from /
Clean-param: jaclosubdomains /*/*html
Clean-param: switch_to_mobile /*/*html
Clean-param: referrer_block /*/*html
Clean-param: normal /*/*html
Clean-param: share-img /*/*html
Clean-param: sa /*/*html
Clean-param: ls /*/*html
Clean-param: articles_subset /
Clean-param: dni  /
Clean-param: switch_to_full /
Clean-param: switch_to_full /*/*html
Clean-param: tab /
Clean-param: tournament_id /
Clean-param: tournament_id /*/*/
Clean-param: track /
Clean-param: tournament_template_id /*/*/
Clean-param: round_id /
Clean-param: cur-group /
Clean-param: sport_type /
Clean-param: category /*/*/
Clean-param: nw /
Clean-param: offline /
Clean-param: source /
Clean-param: inj /
Clean-param: ref /
Clean-param: sl /
Clean-param: utm_source /
Sitemap: https://ria.ru/sitemap_article_index.xml
Sitemap: https://ria.ru/sitemap_list_index.xml
Sitemap: https://ria.ru/sitemap_archive.xml
Sitemap: https://ria.ru/sitemap_event_index.xml
Sitemap: https://ria.ru/sitemap_person_index.xml
Sitemap: https://ria.ru/sitemap_team_index.xml
Sitemap: https://ria.ru/sitemap_tournament.xml
Sitemap: https://ria.ru/sitemap_headtohead_index.xml
Sitemap: https://ria.ru/sitemap_author.xml

History

Changes recorded since June 2026.

No change recorded.

In context

Russia
6.3% block at least one AI crawler
Behind Cloudflare
No