CrawlerPulse
CrawlerPulse / Europe / Ukraine / sevastopol.press

sevastopol.press

sevastopol.press · Ukraine · measured 8 Oct 2026

Google Search
Partial
Google-Extended
Partial
OpenAI
Partial
Anthropic
Partial
Perplexity
Partial
Meta
Partial
Common Crawl
Partial
ByteDance
Partial
Apple
Partial
Amazon
Partial

robots.txt

As read on 8 Oct 2026, 493 bytes. No rule names an AI crawler.

User-agent: *
Disallow: /
Allow: /$
Allow: /20*
Allow: /novosti$
Allow: /novosti/sevastopol$
Allow: /novosti/crimea$
Allow: /novosti/russia$
Allow: /novosti/ukraine$
Allow: /novosti/world$
Allow: /armia-i-flot$
Allow: /dengi$
Allow: /zhizn$
Allow: /zdorovje$
Allow: /kultura$
Allow: /obrazovanie$
Allow: /pogoda$
Allow: /proisshestvia$
Allow: /sport$
Allow: /tehnologii$
Allow: /ekologia$
Allow: /reklama$
Allow: /keyword/
Sitemap: https://sevastopol.press/sitemap.xml

History

Changes recorded since June 2026.

No change recorded.

In context

Ukraine
9.0% block at least one AI crawler
Behind Cloudflare
No