CrawlerPulse
CrawlerPulse / Europe / Russia / euro-football.ru

Euro-football.ru

euro-football.ru · Russia · measured 9 Oct 2026

Google Search
Allowed
Google-Extended
Allowed
OpenAI
Blocked
Anthropic
Allowed
Perplexity
Allowed
Meta
Allowed
Common Crawl
Allowed
ByteDance
Allowed
Apple
Allowed
Amazon
Allowed

robots.txt

As read on 9 Oct 2026, 1,864 bytes. 1 rule group name AI crawlers; shown first.

User-agent: GPTBot
Disallow: /

User-Agent: *
Disallow: /search/
Disallow: /ajax/
Disallow: /user/
Disallow: /admin/
Disallow: /index.php
Disallow: /captcha/
Disallow: /comment/
Disallow: /uefa/
Disallow: /fifa/
Disallow: /outsite/*
Disallow: /comments/*
Disallow: /lr-txt
Disallow: /talk*
Disallow: /wp-content*
Disallow: /assistant/stream-chat
Disallow: /export/
Disallow: /match/txt/
Disallow: /article/hit
Disallow: /article/views-daily
Disallow: /team/*/0
Disallow: /team/*/undefined
Disallow: /team/*/fans
Disallow: /team/*/comment/add
Disallow: /team/*/allmatch
Disallow: /team/*/*/allmatch
Disallow: /person/*/0
Disallow: /person/*/undefined
Disallow: /person/*/fans
Disallow: /person/*/comment/add
Disallow: /forecast/*/*
Disallow: /forecast/*/*/*
Disallow: /category/tour/*
Disallow: /category/*/tour/*
Disallow: /category/*/tables*
Disallow: /category/tables*
Disallow: /category/result/*
Disallow: /category/news/*
Disallow: /category/map/*
Disallow: /category/showtag/*
Disallow: /category/checkerboard/*
Disallow: /category/searchtag/
Disallow: /*/*/*/*/1
Disallow: /*/*/*/text/
Disallow: /*/*/*/text
Disallow: /*/*/commentary/*/*/*
Clean-param: team1 /online/h2h
Clean-param: team2 /online/h2h
Clean-param: team1 /h2h/index
Clean-param: team2 /h2h/index
Clean-param: date_from&date_to /article
Clean-param: turnir_id /article
Clean-param: page /rating/teams
Clean-param: page /rating/persons
Host: https://www.euro-football.ru
Sitemap: https://www.euro-football.ru/sitemap.xml
Sitemap: https://www.euro-football.ru/sitemap5.xml
Sitemap: https://www.euro-football.ru/sitemap.news.xml

History

Changes recorded since June 2026.

No change recorded.

In context

Russia
6.3% block at least one AI crawler
Behind Cloudflare
No