TASS

tass.ru · Russia · measured 9 Oct 2026

Google Search

Allowed

Google-Extended

Allowed

OpenAI

Allowed

Anthropic

Allowed

Perplexity

Allowed

robots.txt

As read on 9 Oct 2026, 901 bytes. No rule names an AI crawler.

User-agent: YandexNews
Allow: /rss/yandex.xml

User-agent: *
Disallow: /search
Disallow: /preview/
Disallow: /n/
Disallow: */api/*
Disallow: /video/
Disallow: /obschestvo/24833475
Disallow: /obschestvo/26943231

User-agent: YandexBot
Disallow: /search
Disallow: /preview/
Disallow: /n/
Disallow: */api/*
Disallow: /glavnie-novosti$
Disallow: */amp
Disallow: /obschestvo/24833475
Disallow: /obschestvo/26943231
Clean-param: nw&following_ch&keepThis&mobile&disableGlobalInfoCollect&spush&utm_test&ref&_gl&post&amp&mindbox-message-key
Clean-param: utm_&erid&mbstx&pass&following_op&s&smclient&hcb&bx_sender_conversion_id&utm_partner_id&variant&zarsrc&hl&following_other&mibextid&ut

User-agent: Googlebot
Disallow: /novosti-partnerov
Disallow: /search
Disallow: /preview/
Disallow: /n/
Disallow: */api/*
Disallow: /obschestvo/24833475
Disallow: /obschestvo/26943231
Sitemap: https://tass.ru/sitemap.xml

History

Changes recorded since June 2026.

No change recorded.

In context

Russia

6.3% block at least one AI crawler

Behind Cloudflare