Zavtra

zavtra.ru · Russia · measured 9 Oct 2026

Google Search

Allowed

Google-Extended

Allowed

OpenAI

Allowed

Anthropic

Allowed

Perplexity

Allowed

robots.txt

As read on 9 Oct 2026, 242 bytes. No rule names an AI crawler.

User-agent: Yandex
Allow: /
Allow: /content/zen-feed.xml
Disallow: /search

User-agent: AdsBot-Google
Allow: /
Disallow: /search

User-agent: *
Allow: /
Disallow: /search
Crawl-Delay: 5
Host: zavtra.ru
Sitemap: https://zavtra.ru/sitemap.xml

History

Changes recorded since June 2026.

No change recorded.

In context

Russia

6.3% block at least one AI crawler

Behind Cloudflare