CrawlerPulse
CrawlerPulse / South America / Brazil / r7.com

R7

r7.com · Brazil · Record · measured 8 Oct 2026

Google Search
Allowed
Google-Extended
Allowed
OpenAI
Allowed
Anthropic
Allowed
Perplexity
Allowed
Meta
Allowed
Common Crawl
Allowed
ByteDance
Allowed
Apple
Allowed
Amazon
Allowed

robots.txt

As read on 8 Oct 2026, 1,171 bytes. 2 rule groups name AI crawlers; shown first.

User-agent: GPTBot
Allow: /

User-agent: Google-Extended
Allow: /

Sitemap: https://www.r7.com/arc/outboundfeeds/sitemap-news-index/
Sitemap: https://www.r7.com/arc/outboundfeeds/sitemap-section-index/
Sitemap: https://www.r7.com/arc/outboundfeeds/sitemap-index-byday/

User-agent: proximic
Disallow: /

User-agent: SemrushBot
Disallow: /

User-agent: Twitterbot
Allow: /

User-agent: SemrushBot-SA
Disallow: /

User-agent: Starkbot
Disallow: /

User-agent: Scrapy
Disallow: /

User-Agent: VoluumDSP-content-bot
Disallow: /

User-agent: Seekport Crawler
Disallow: /

User-agent: *
Allow: /
Disallow: /busca/*
Disallow: /tudo-do-r7/*
Disallow: /login-tv/*
Disallow: /login-tv-qa/*
Disallow: /login-tv-stage/*
Disallow: /iframes/*
Disallow: /tim-fun/*
Disallow: /tudo-da-ri7a/*
Disallow: /guidebook/*
Disallow: /guidebook-fazenda/*
Disallow: /todos-os-videos/*
Disallow: /validacao/*
Disallow: /embeds/
Disallow: /index2.html
Disallow: /supprod2022/*
Disallow: /suporte/*
Disallow: /media/*
Disallow: /menusidebardestaques*
Disallow: /menusidebarsecoes*
Disallow: /footersitemap*
Disallow: /menuinstitucional*
Disallow: /menuprincipal*
Disallow: /menusidebarinstitucional*

History

Changes recorded since June 2026.

No change recorded.

In context

Brazil
14.5% block at least one AI crawler
Behind Cloudflare
No