CrawlerPulse
CrawlerPulse / Europe / Russia / severinform.ru

Sever Inform

severinform.ru · Russia · measured 8 Oct 2026

Google Search
Allowed
Google-Extended
Allowed
OpenAI
Allowed
Anthropic
Allowed
Perplexity
Allowed
Meta
Allowed
Common Crawl
Allowed
ByteDance
Allowed
Apple
Allowed
Amazon
Allowed

robots.txt

As read on 8 Oct 2026, 528 bytes. No rule names an AI crawler.

User-agent: *
Disallow: /index.php?page=news&*pr=0
Disallow: /?page=news&col=*&rg=
Disallow: /?page=news&*&col=
Disallow: /index.php?page=news&*&col=
Disallow: /index.php?page=news&rg=
Disallow: /?page=topic&topicid=*&p=
Disallow: /index.php?page=topic
Disallow: /index.php?page=public
Disallow: /?page=public
Disallow: /index.php?page=archive
Disallow: /?page=archive
Disallow: /index.php?page=search
Disallow: /?page=search
Disallow: /go/
Disallow: /print.php
Disallow: /qppartner
Disallow: /newsadmin
Host: www.severinform.ru

History

Changes recorded since June 2026.

No change recorded.

In context

Russia
6.3% block at least one AI crawler
Behind Cloudflare
No