CrawlerPulse
CrawlerPulse / Europe / Serbia / beograd.rs

beograd.rs

beograd.rs · Serbia · measured 8 Oct 2026

Google Search
Allowed
Google-Extended
Allowed
OpenAI
Allowed
Anthropic
Allowed
Perplexity
Allowed
Meta
Allowed
Common Crawl
Allowed
ByteDance
Allowed
Apple
Allowed
Amazon
Allowed

robots.txt

As read on 8 Oct 2026, 885 bytes. No rule names an AI crawler.

User-agent: *
Disallow: /v3api/
Disallow: /api/v3/documents/
Disallow: /app/
Disallow: /content/
Disallow: /data
Disallow: /External-NEWS/
Disallow: /feed/
Disallow: /ignoreThis_
Disallow: /Preview/
Disallow: /Shop/
Disallow: */article/preview/
Disallow: */comments
Disallow: */External-Articles
Disallow: */insertcomment/
Disallow: */pageelements/
Allow: /lazy/pageelements/
Disallow: */search/
Disallow: *?element=TagList$
Disallow: *documentId
Disallow: /*?print$
Disallow: /.well-known/amphtml/apikey.pub
Disallow: /api/v3/polls/
Disallow: /pagepositionelements/
Disallow: */search/3/1
Disallow: */cir/Lokacije-prioritet/
Disallow: */lat/Lokacije-prioritet/
Disallow: */cir/Logotipi/
Disallow: */lat/Logotipi/
Disallow: */cir/FAQ/
Disallow: */lat/FAQ/

User-agent: W3C_Validator
Disallow: /
Sitemap: https://www.beograd.rs/sitemaps/index.xml

History

Changes recorded since June 2026.

No change recorded.

In context

Serbia
3.8% block at least one AI crawler
Behind Cloudflare
Yes