CrawlerPulse
CrawlerPulse / Europe / Russia / sputnikglobe.com

Sputnik

sputnikglobe.com · Russia · measured 9 Oct 2026

Google Search
Allowed
Google-Extended
Allowed
OpenAI
Allowed
Anthropic
Allowed
Perplexity
Allowed
Meta
Allowed
Common Crawl
Allowed
ByteDance
Allowed
Apple
Allowed
Amazon
Allowed

robots.txt

As read on 9 Oct 2026, 381 bytes. No rule names an AI crawler.

User-agent: *
Disallow: *-print.html$
Disallow: /sys_*
Disallow: /search/
Disallow: /services/
Disallow: /cms/
Disallow: */calendar.html
Disallow: /_editorial_preview_*
Clean-param: param /
Clean-param: nid /
Sitemap: https://sputnikglobe.com/sitemap_article_index.xml
Sitemap: https://sputnikglobe.com/sitemap_list_index.xml
Sitemap: https://sputnikglobe.com/sitemap_archive.xml

History

Changes recorded since June 2026.

No change recorded.

In context

Russia
6.3% block at least one AI crawler
Behind Cloudflare
No