CrawlerPulse
CrawlerPulse / Europe / Russia / fontanka.ru

fontanka.ru

fontanka.ru · Russia · measured 9 Oct 2026

Google Search
Allowed
Google-Extended
Allowed
OpenAI
Blocked
Anthropic
Allowed
Perplexity
Allowed
Meta
Allowed
Common Crawl
Allowed
ByteDance
Allowed
Apple
Allowed
Amazon
Allowed

robots.txt

As read on 9 Oct 2026, 4,130 bytes. 2 rule groups name AI crawlers; shown first.

User-agent: GPTBot
Disallow: /

User-agent: ChatGPT-User
Disallow: /

User-agent: Mail.ru
Allow: */?from=yanews
Allow: /rss-feeds/zen-news.xml

User-agent: Zen_Bot/2.0
Allow: *?from=
Allow: *?utm_source=
Allow: /__forYandex/last/for_yandex.xml
Allow: /fontanka/last/for_yandex_zen_total.xml
Allow: /rss-feeds/zen-news-webmaster.xml
Allow: /rss-feeds/zen-news.xml

User-agent: YandexNews
Allow: *?from=
Allow: */yanews/
Allow: /rss/yandex/
Allow: *?utm_source=
Allow: /__forYandex/last/for_yandex.xml
Allow: /fontanka/last/for_yandex_zen_total.xml
Allow: /rss-feeds/zen-news-webmaster.xml
Allow: /rss-feeds/zen-news.xml

User-agent: Yandex
Disallow: /2024/08/17/73972169/
Disallow: /2024/08/16/73970924/
Disallow: /longreads/72981971/
Disallow: /currency.html?
Disallow: /cgi-bin/
Disallow: /search.html?
Disallow: /www-include/
Disallow: /pic/decor/
Disallow: /users/
Disallow: /subscription/
Disallow: /subscriptions/
Disallow: /subscription_promo/
Disallow: /gm-api/
Disallow: /quizzes/
Disallow: /_report/
Allow: /html-to-img/
Disallow: /_sentry/
Disallow: /customUrlComments/
Disallow: *?
Allow: *?erid=
Allow: /__forYandex/last/for_yandex.xml
Allow: /fontanka/last/for_yandex_zen_total.xml
Allow: /rss-feeds/zen-news.xml
Disallow: */m.html$
Disallow: */print.html$
Disallow: */index.html$
Disallow: */pda.html$
Disallow: */all.html$
Disallow: */news.html$
Disallow: */article.html$
Disallow: */fotoreport.html$
Disallow: */businews.html$
Disallow: /__site/
Disallow: *big.*.html$
Disallow: *map.*.html$
Disallow: *report.*.html$
Disallow: *picture.*.html$
Disallow: *infograph.*.html$
Disallow: /*/print.html
Disallow: /*/pda.html
Disallow: /*/fotoreport.html
Disallow: /*/for_twitter.xml
Disallow: */24hours.html
Disallow: */24hours_news.html
Disallow: */24hours_articles.html
Disallow: */24hours_article.html
Disallow: */articles.html$
Disallow: /afisha/all-events/
Disallow: /afisha/cinema-events/
Disallow: /afisha/concert-events/
Disallow: /afisha/theatre-events/
Disallow: /afisha/kids-events/
Disallow: /afisha/sport-events/
Disallow: /afisha/art-events/
Disallow: /afisha/other-events/
Clean-param: page *
Clean-param: startedAtGte&place&kids&free&previewToken *
Clean-param: recordId&regionId&mobile&isPreview&sharePost *
Clean-param: block&imageViewer&amp&full&discuss&auth_error&first&mobile&email&rubric&preview *
Clean-param: cookie_disabled&i&nw&path&rec&redirect_error&utm&shareRecordImage&birthcity&birthregion *
Clean-param: faculty&r&ngs_news_test&utm_source&utm_medium&utm_campaign&utm_content&utm_term *

User-agent: *
Allow: /rss-feeds/zen-news.xml
Disallow: /2024/08/17/73972169/
Disallow: /2024/08/16/73970924/
Disallow: /longreads/72981971/
Disallow: /currency.html?
Disallow: /cgi-bin/
Disallow: /search.html?
Disallow: /www-include/
Disallow: /pic/decor/
Disallow: /users/
Disallow: /subscription/
Disallow: /subscriptions/
Disallow: /subscription_promo/
Disallow: /gm-api/
Disallow: /quizzes/
Disallow: /_report/
Allow: /html-to-img/
Disallow: *?
Allow: *?erid=
Allow: /__forYandex/last/for_yandex.xml
Allow: /fontanka/last/for_yandex_zen_total.xml
Allow: /rss-feeds/zen-news.xml
Allow: /rss-feeds/zen-news-webmaster.xml
Disallow: */m.html$
Disallow: */print.html$
Disallow: */index.html$
Disallow: */pda.html$
Disallow: */all.html$
Disallow: */news.html$
Disallow: */article.html$
Disallow: */fotoreport.html$
Disallow: */businews.html$
Disallow: /__site/
Disallow: *big.*.html$
Disallow: *map.*.html$
Disallow: *report.*.html$
Disallow: *picture.*.html$
Disallow: *infograph.*.html$
Disallow: /*/print.html
Disallow: /*/pda.html
Disallow: /*/fotoreport.html
Disallow: /*/for_twitter.xml
Disallow: */24hours.html
Disallow: */24hours_news.html
Disallow: */24hours_articles.html
Disallow: */24hours_article.html
Disallow: */articles.html$
Disallow: /afisha/all-events/
Disallow: /afisha/cinema-events/
Disallow: /afisha/concert-events/
Disallow: /afisha/theatre-events/
Disallow: /afisha/kids-events/
Disallow: /afisha/sport-events/
Disallow: /afisha/art-events/
Disallow: /afisha/other-events/
Sitemap: https://www.fontanka.ru/sitemaps/index.xml.gz

History

Changes recorded since June 2026.

No change recorded.

In context

Russia
6.3% block at least one AI crawler
Behind Cloudflare
No