CrawlerPulse
CrawlerPulse / Europe / Ukraine / rbc.ua

RBK

rbc.ua · Ukraine · RBK (Ukrainian) · measured 8 Oct 2026

Google Search
Allowed
Google-Extended
Allowed
OpenAI
Allowed
Anthropic
Allowed
Perplexity
Allowed
Meta
Allowed
Common Crawl
Allowed
ByteDance
Allowed
Apple
Allowed
Amazon
Allowed

robots.txt

As read on 8 Oct 2026, 312 bytes. No rule names an AI crawler.

User-Agent: *
Disallow: /?/
Disallow: /*?sver=*
Disallow: /promo/*
Disallow: /*/test/*
Disallow: /*/print/*
Disallow: /links.html
Disallow: /rus/top/new/*
Disallow: /ukr/top/new/*
Disallow: /rus/top/new/economic
Disallow: /hits/
Disallow: /cdn-cgi/
Sitemap: https://www.rbc.ua/static/sitemap/sitemap.index.xml

History

Changes recorded since June 2026.

No change recorded.

In context

Ukraine
9.0% block at least one AI crawler
Behind Cloudflare
Yes