CrawlerPulse
CrawlerPulse / Europe / Serbia / mondo.rs

mondo.rs

mondo.rs · Serbia · measured 8 Oct 2026

Google Search
Allowed
Google-Extended
Allowed
OpenAI
Allowed
Anthropic
Allowed
Perplexity
Allowed
Meta
Allowed
Common Crawl
Allowed
ByteDance
Allowed
Apple
Allowed
Amazon
Allowed

robots.txt

As read on 8 Oct 2026, 1,337 bytes. No rule names an AI crawler.

user-agent: *
Disallow: /cdn-cgi/
Disallow: /chat
Disallow: /komunikator
Disallow: /download
Disallow: *?gallery
Disallow: /rbt/
Disallow: /mnmht
Disallow: /mnrbt
Disallow: /cs/
Disallow: /mojhaloton/mapasajta
Disallow: /Camera/
Disallow: /login
Disallow: /%
Disallow: /preview_story
Disallow: /n373/Besplatni-SMS
Disallow: /Naslovna/Najnovije-vesti
Disallow: /tg/
Disallow: /v2/
Disallow: /*%20
Disallow: /*.php?id=
Disallow: /*.php?kat=
Disallow: /*.php?vest=
Disallow: /lg/
Disallow: */MTS/
Disallow: */contentList/
Disallow: /*?article_bottom_redrcmd
Disallow: /app/
Disallow: /feed/
Disallow: /*?print$
Disallow: /Shop/
Disallow: /.well-known/amphtml/apikey.pub
Disallow: */insertcomment/
Disallow: */search/1/
Disallow: */External-Articles
Disallow: *documentId
Disallow: */article/preview/
Disallow: /Preview/
Disallow: /content/
Disallow: /api/v3/documents/
Disallow: /api/v3/polls/
Disallow: */pageelements/
Disallow: /ignoreThis_
Allow: /lazy/pageelements/
Disallow: *?element=TagList$
Disallow: */search/gcse?q=$
Disallow: /External-NEWS/
Disallow: /pagepositionelements/
Disallow: */comments/
Disallow: /Binary/

User-agent: facebookexternalhit
Disallow: /api/
Allow: /
Sitemap: https://mondo.rs/sitemaps/index.xml
Sitemap: https://mondo.rs/sitemaps/news-sitemap.xml

History

Changes recorded since June 2026.

No change recorded.

In context

Serbia
3.8% block at least one AI crawler
Behind Cloudflare
No