CrawlerPulse
CrawlerPulse / Europe / Russia / realnoevremya.ru

Real Time

realnoevremya.ru · Russia · measured 9 Oct 2026

Google Search
Allowed
Google-Extended
Allowed
OpenAI
Allowed
Anthropic
Allowed
Perplexity
Allowed
Meta
Allowed
Common Crawl
Allowed
ByteDance
Allowed
Apple
Allowed
Amazon
Allowed

robots.txt

As read on 9 Oct 2026, 1,446 bytes. No rule names an AI crawler.

User-agent: *
Disallow: /technical-work*
Disallow: /partner*
Disallow: /today*
Disallow: /*?utm_*
Disallow: /*?keyword*
Disallow: */print$
Disallow: /preview*
Disallow: /news/195402-dva-rukovoditelya-suvar-developmenta-ushli-ot-subsidiarnoy
Sitemap: https://realnoevremya.ru/sitemap-index.xml
Sitemap: https://realnoevremya.ru/sitemap.xml
Sitemap: https://realnoevremya.ru/sitemap-materials.xml
Sitemap: https://realnoevremya.ru/sitemap-articles.xml
Sitemap: https://realnoevremya.ru/sitemap-events.xml
Sitemap: https://realnoevremya.ru/sitemap-galleries.xml
Sitemap: https://realnoevremya.ru/sitemap-news.xml
Sitemap: https://realnoevremya.ru/sitemap-stories.xml
Sitemap: https://realnoevremya.ru/sitemap-articles-today.xml
Sitemap: https://realnoevremya.ru/sitemap-news-today.xml
Sitemap: https://realnoevremya.ru/sitemap-catalog.xml
Sitemap: https://realnoevremya.ru/sitemap-search-words.xml
Sitemap: https://realnoevremya.ru/sitemap-search-key.xml
Sitemap: https://realnoevremya.ru/files/sitemap-search-stroy-1.xml
Sitemap: https://realnoevremya.ru/files/sitemap-search-stroy-2.xml

User-agent: Yandex
Disallow: /*?keyword*
Disallow: /*?utm_*
Disallow: */amp$
Disallow: /sitemap-articles.xml
Disallow: /sitemap-news.xml
Disallow: /sitemap-catalog.xml
Disallow: /partner*
Disallow: /preview*
Disallow: /today*
Disallow: /news/195402-dva-rukovoditelya-suvar-developmenta-ushli-ot-subsidiarnoy
Disallow: */print$
Host: https://realnoevremya.ru

History

Changes recorded since June 2026.

No change recorded.

In context

Russia
6.3% block at least one AI crawler
Behind Cloudflare
No