CrawlerPulse
CrawlerPulse / Asia / Kazakhstan / informburo.kz

informburo.kz

informburo.kz · Kazakhstan · measured 8 Oct 2026

Google Search
Allowed
Google-Extended
Allowed
OpenAI
Allowed
Anthropic
Allowed
Perplexity
Allowed
Meta
Allowed
Common Crawl
Allowed
ByteDance
Allowed
Apple
Allowed
Amazon
Allowed

robots.txt

As read on 8 Oct 2026, 2,380 bytes. No rule names an AI crawler.

User-agent: *
Disallow: /nova/
Disallow: /fpanel/
Disallow: /livewire/
Disallow: /livewire-*/update
Disallow: /arrilot/
Disallow: /member/
Disallow: /preview/
Disallow: /api/addPageViews
Disallow: /getUserID
Disallow: /qrcode/
Disallow: /search?
Disallow: /new-search
Disallow: /*?utm_
Disallow: /*?*fbclid=
Disallow: /*?*yclid=
Disallow: /*?*gclid=
Disallow: /*?*wbraid=
Disallow: /*?*_utl_t=
Disallow: /*?*ya_src=
Disallow: /*?*yrwinfo=
Disallow: /*?*tg_rhash=
Disallow: /*?*_gl=
Disallow: /*?*media_id=
Allow: /build/
Allow: /css/
Allow: /js/
Allow: /img/

User-agent: Googlebot
Disallow: /nova/
Disallow: /fpanel/
Disallow: /livewire/
Disallow: /livewire-*/update
Disallow: /arrilot/
Disallow: /member/
Disallow: /preview/
Disallow: /api/addPageViews
Disallow: /getUserID
Disallow: /qrcode/
Disallow: /search?
Disallow: /new-search
Disallow: /*?utm_
Disallow: /*?*fbclid=
Disallow: /*?*yclid=
Disallow: /*?*gclid=
Disallow: /*?*wbraid=
Disallow: /*?*_utl_t=
Disallow: /*?*ya_src=
Disallow: /*?*yrwinfo=
Disallow: /*?*tg_rhash=
Disallow: /*?*_gl=
Disallow: /*?*media_id=
Allow: /build/
Allow: /css/
Allow: /js/
Allow: /img/

User-agent: Googlebot-News
Disallow: /nova/
Disallow: /fpanel/
Disallow: /livewire/
Disallow: /livewire-*/update
Disallow: /arrilot/
Disallow: /member/
Disallow: /preview/
Disallow: /api/addPageViews
Disallow: /getUserID
Disallow: /qrcode/
Disallow: /search?
Disallow: /new-search
Disallow: /*?utm_
Disallow: /*?*fbclid=
Disallow: /*?*yclid=
Disallow: /*?*gclid=
Disallow: /*?*wbraid=
Disallow: /*?*_utl_t=
Disallow: /*?*ya_src=
Disallow: /*?*yrwinfo=
Disallow: /*?*tg_rhash=
Disallow: /*?*_gl=
Disallow: /*?*media_id=
Allow: /build/
Allow: /css/
Allow: /js/
Allow: /img/

User-agent: Yandex
Disallow: /nova/
Disallow: /fpanel/
Disallow: /livewire/
Disallow: /livewire-*/update
Disallow: /arrilot/
Disallow: /member/
Disallow: /preview/
Disallow: /api/addPageViews
Disallow: /getUserID
Disallow: /qrcode/
Disallow: /search?
Disallow: /new-search
Disallow: /*?utm_
Disallow: /*?*fbclid=
Disallow: /*?*yclid=
Disallow: /*?*gclid=
Disallow: /*?*wbraid=
Disallow: /*?*_utl_t=
Disallow: /*?*ya_src=
Disallow: /*?*yrwinfo=
Disallow: /*?*tg_rhash=
Disallow: /*?*_gl=
Disallow: /*?*media_id=
Allow: /build/
Allow: /css/
Allow: /js/
Allow: /img/
Sitemap: https://informburo.kz/sitemap.xml
Sitemap: https://informburo.kz/sitemap-news.xml

History

Changes recorded since June 2026.

No change recorded.

In context

Kazakhstan
7.8% block at least one AI crawler
Behind Cloudflare
No