CrawlerPulse
CrawlerPulse / Europe / Serbia / kurir.rs

kurir.rs

kurir.rs · Serbia · measured 8 Oct 2026

Google Search
Allowed
Google-Extended
Allowed
OpenAI
Allowed
Anthropic
Allowed
Perplexity
Allowed
Meta
Allowed
Common Crawl
Allowed
ByteDance
Allowed
Apple
Allowed
Amazon
Allowed

robots.txt

As read on 8 Oct 2026, 990 bytes. No rule names an AI crawler.

User-agent: *
Disallow: /ajax/
Disallow: /api-v2/
Disallow: /izbori-2020-widget
Disallow: /news_widget
Disallow: /pretraga/
Disallow: /resources/templates/
Disallow: /sport/livescores/
Disallow: /stil-widget/
Disallow: /widget/
Disallow: /*.html$
Disallow: /v3api/
Disallow: /api/v3/documents/
Disallow: /app/
Disallow: /content/
Disallow: /data
Disallow: /External-NEWS/
Disallow: /feed/
Disallow: /ignoreThis_
Disallow: /Preview/
Disallow: /Shop/
Disallow: */article/preview/
Disallow: */comments
Disallow: /External-Articles/
Disallow: */insertcomment/
Disallow: /pageelements/
Disallow: /pageelements/*/PreviousNextDocument/
Allow: /lazy/pageelements/
Disallow: */search/
Disallow: *?element=TagList$
Disallow: *documentId
Disallow: /*?print$
Disallow: /.well-known/amphtml/apikey.pub
Disallow: /api/v3/polls/
Disallow: /pagepositionelements/
Sitemap: https://www.kurir.rs/sitemaps-v2/index.xml
Sitemap: https://www.kurir.rs/sitemaps-v2/news.xml

History

Changes recorded since June 2026.

No change recorded.

In context

Serbia
3.8% block at least one AI crawler
Behind Cloudflare
No