CrawlerPulse
CrawlerPulse / Europe / Serbia / rtv.rs

RTV

rtv.rs · Serbia · measured 8 Oct 2026

Google Search
Allowed
Google-Extended
Blocked
OpenAI
Blocked
Anthropic
Blocked
Perplexity
Blocked
Meta
Blocked
Common Crawl
Blocked
ByteDance
Blocked
Apple
Blocked
Amazon
Blocked

robots.txt

As read on 8 Oct 2026, 1,298 bytes. 1 rule group name AI crawlers; shown first.

User-agent: omgilibot
Disallow: /

User-agent: Slurp
Allow: /

User-agent: Yahoo! Slurp
Allow: /

User-agent: Twitterbot
Allow: /

User-agent: facebookexternalhit
Allow: /

User-agent: DeuSu
Disallow: /

User-agent: AhrefsBot
Disallow: /

User-agent: Applebot
Disallow: /

User-agent: YandexBot
Disallow: /

User-agent: psbot
Disallow: /

User-agent: Yeti
Disallow: /

User-agent: Baiduspider
Disallow: /

User-agent: bingbot
Allow: /

User-agent: MJ12bot
Disallow: /

User-agent: Exabot
Disallow: /

User-agent: Mediatoolkitbot
Disallow: /

User-agent: SputnikBot
Disallow: /

User-agent: ltx71
Disallow: /

User-agent: SentiBot
Disallow: /

User-agent: Genieo
Disallow: /

User-agent: LinkedInBot
Disallow: /

User-agent: Kraken
Disallow: /

User-agent: Cutbot
Disallow: /

User-agent: FlipboardProxy
Disallow: /

User-agent: Feedspotbot
Disallow: /

User-agent: Googlebot
Disallow: /sr_ci/news/print
Disallow: /sr_lat/news/print
Disallow: /hu/news/print
Disallow: /rsn/news/print
Disallow: /sk/news/print
Disallow: /ro/news/print
Disallow: /rom/news/print
Disallow: /dwr
Disallow: /css
Disallow: /js
Disallow: /sr_lat/komentar
Disallow: /sr_ci/komentar
Allow: /

User-agent: *
Disallow: /

History

Changes recorded since June 2026.

No change recorded.

In context

Serbia
3.8% block at least one AI crawler
Behind Cloudflare
No