CrawlerPulse
CrawlerPulse / Europe / Ukraine / 24tv.ua

24tv

24tv.ua · Ukraine · measured 8 Oct 2026

Google Search
Allowed
Google-Extended
Allowed
OpenAI
Allowed
Anthropic
Allowed
Perplexity
Allowed
Meta
Allowed
Common Crawl
Allowed
ByteDance
Allowed
Apple
Allowed
Amazon
Allowed

robots.txt

As read on 8 Oct 2026, 711 bytes. No rule names an AI crawler.

User-agent: *
Allow: /
Disallow: /*?f=false
Disallow: /cdn-cgi/
Disallow: /football/
Disallow: /home/
Disallow: /tags/
Disallow: /users/
Disallow: /plugins/
Disallow: /56301415/
Disallow: /113579682/
Disallow: /news/updateReviewsCount.ajx
Disallow: /fb-messenger://share/*
Disallow: /viber://forward*
Disallow: /*amp?siteId*
Disallow: /newsCreated*
Disallow: /removeNews*
Disallow: /newNews*
Disallow: /translatedNewsChannelSubscribe*
Disallow: /v2/
Disallow: /new-main-page
Disallow: /search*
Disallow: /mobile/
Disallow: /archive/
Disallow: /short_n*
Disallow: /weather/
Disallow: /auto/tag/
Disallow: /auto/carSpec/
Disallow: /auto/counter/
Disallow: /injection/
Sitemap: https://24tv.ua/sitemapindex.xml

History

Changes recorded since June 2026.

No change recorded.

In context

Ukraine
9.0% block at least one AI crawler
Behind Cloudflare
Yes