CrawlerPulse
CrawlerPulse / Europe / Ukraine / kafanews.com

Kafa

kafanews.com · Ukraine · Kafa (Russian) · measured 8 Oct 2026

Google Search
Partial
Google-Extended
Partial
OpenAI
Partial
Anthropic
Partial
Perplexity
Partial
Meta
Partial
Common Crawl
Partial
ByteDance
Partial
Apple
Partial
Amazon
Partial

robots.txt

As read on 8 Oct 2026, 615 bytes. No rule names an AI crawler.

User-agent: *
Host: https://kafanews.com
Disallow: /cgi-bin
Disallow: /fraza
Disallow: /own
Allow: /news/feo
Allow: /news/crimea
Allow: /news/ukr
Allow: /news/press
Disallow: /news/
Allow: /new/images
Disallow: /new
Disallow: /journ
Disallow: /users
Disallow: /arhiv
Disallow: /fotos
Disallow: /gallery
Disallow: /tag

User-agent: Yandex
Disallow: /cgi-bin
Disallow: /fraza
Disallow: /own
Allow: /news/feo
Allow: /news/crimea
Allow: /news/ukr
Allow: /news/press
Disallow: /news/
Allow: /new/images
Disallow: /new
Disallow: /journ
Disallow: /users
Disallow: /arhiv
Disallow: /fotos
Disallow: /tag

History

Changes recorded since June 2026.

No change recorded.

In context

Ukraine
9.0% block at least one AI crawler
Behind Cloudflare
Yes