CrawlerPulse
CrawlerPulse / Europe / Ukraine / ogo.ua

ogo.ua

ogo.ua · Ukraine · measured 8 Oct 2026

Google Search
Allowed
Google-Extended
Allowed
OpenAI
Allowed
Anthropic
Allowed
Perplexity
Allowed
Meta
Allowed
Common Crawl
Allowed
ByteDance
Allowed
Apple
Allowed
Amazon
Allowed

robots.txt

As read on 8 Oct 2026, 2,495 bytes. No rule names an AI crawler.

User-agent: *
Crawl-delay: 5
Disallow: /?s=
Disallow: /page/*/?s=
Disallow: /search/
Disallow: /wp-json/
Disallow: /?rest_route=
Disallow: /tag/
Allow: /tag/vijna-z-rosiyeyu/
Allow: /tag/nashi-zahysnyky/
Allow: /tag/pereselenczi/
Allow: /tag/prognoz-pogody/
Allow: /tag/goroskop/
Allow: /tag/molitvy/
Allow: /tag/grafiky-vidklyuchennya-svitla/
Allow: /tag/health/
Allow: /tag/sport/
Allow: /tag/magnitni-buri/
Allow: /tag/dtp/
Allow: /tag/pozhezha/
Allow: /tag/avariya/
Allow: /tag/policziya/
Allow: /tag/ryatuvalnyky/
Allow: /tag/vijna/
Allow: /tag/vijskovi/
Allow: /tag/groshi/
Allow: /tag/robota/
Allow: /tag/dity/
Allow: /tag/konczert/
Allow: /tag/svyata/
Allow: /tag/kalendar/
Allow: /tag/den-angela/
Allow: /tag/dubno/
Allow: /tag/polegli-zahysnyky/
Allow: /tag/zvilneni-z-polonu/
Allow: /tag/kryteriyi-vyboru/
Allow: /tag/korysni-porady/
Allow: /tag/molytvy/
Allow: /tag/den-narodzhennya/
Allow: /tag/rivnyany/
Allow: /tag/reczepty/
Allow: /tag/vitannya/
Allow: /tag/ukrayina/
Allow: /tag/koronavirus/
Allow: /tag/smert/
Allow: /tag/yuvilej/
Allow: /tag/dacha-sad-gorod/
Allow: /tag/futbol/
Allow: /tag/znaky-zadiaku/
Allow: /tag/vid-chytachiv/
Allow: /tag/rosiya/
Allow: /tag/dopomoga/
Allow: /tag/vybory/
Allow: /tag/rivnenska-miska-rada/
Allow: /tag/volyn/
Allow: /tag/veres/
Allow: /tag/sud/
Allow: /tag/shkoly/
Allow: /tag/avtomobil/
Allow: /tag/vidpochynok
Allow: /tag/navchannya/
Allow: /tag/dolar/
Allow: /tag/kurs-valyut/
Allow: /tag/ukrzaliznyczya/
Allow: /tag/kudy-pity-u-rivnomu/
Allow: /tag/zsu/
Allow: /tag/yevro/
Allow: /tag/osvita/
Allow: /tag/dopomoga-zsu/
Allow: /tag/prykoly-vid-mykoly/
Allow: /tag/volodymyr-zelenskyj/
Allow: /tag/proshhannya-iz-zahysnykamy/
Allow: /tag/son/
Allow: /tag/transportna-karta/
Disallow: /tag/*?*
Disallow: /author/
Disallow: /*?utm_*
Disallow: /*&utm_*
Disallow: /wp-admin/
Allow: /wp-admin/admin-ajax.php
Disallow: /wp-includes/

User-agent: Yandex
Disallow: /

User-agent: YandexBot
Disallow: /

User-agent: YandexImages
Disallow: /

User-agent: YandexVideo
Disallow: /

User-agent: YandexMobileBot
Disallow: /

User-agent: YandexNews
Disallow: /

User-agent: Mail.RU_Bot
Disallow: /

User-agent: MailRuBot
Disallow: /

User-agent: SputnikBot
Disallow: /

User-agent: NigmaBot
Disallow: /

User-agent: MegaIndex
Disallow: /

User-agent: Cogentbot
Disallow: /

User-agent: COGENT-A
Disallow: /
Sitemap: https://ogo.ua/sitemap_index.xml

History

Changes recorded since June 2026.

No change recorded.

In context

Ukraine
9.0% block at least one AI crawler
Behind Cloudflare
No