CrawlerPulse
CrawlerPulse / South America / Brazil / gazetaesportiva.com

gazetaesportiva.com

gazetaesportiva.com · Brazil · measured 8 Oct 2026

Google Search
Allowed
Google-Extended
Allowed
OpenAI
Allowed
Anthropic
Allowed
Perplexity
Allowed
Meta
Allowed
Common Crawl
Allowed
ByteDance
Allowed
Apple
Allowed
Amazon
Allowed

robots.txt

As read on 8 Oct 2026, 2,733 bytes. 1 rule group name AI crawlers; shown first.

User-Agent: Googlebot-News
User-agent: Mediapartners-Google
User-agent: Google-Extended
User-agent: bingbot
User-agent: Twitterbot
User-agent: ClaudeBot
User-agent: CloudflareBrowserRenderingCrawler
User-agent: GPTBot
User-agent: ChatGPT-User
User-agent: ChatGPT-User/2.0
User-agent: PerplexityBot
User-agent: meta-externalagent
User-agent: Amazonbot
User-agent: Applebot-Extended
User-agent: BDCbot
User-agent: CCBot
User-agent: Bytespider
User-agent: Slurp
Allow: /
Allow: /times/brasil/
Allow: /copa-do-mundo/
Allow: /campeonatos/brasileiro serie-a/
Allow: /campeonatos/brasileiro-serie-b/
Allow: /campeonatos/copa-sulamericana/
Allow: /campeonatos/libertadores-da-america/
Allow: /campeonatos/mundial-de-clubes-fifa/
Allow: /campeonatos/copa-do-brasil/
Allow: /campeonatos/copa-sao-paulo/
Allow: /campeonatos/copa-do-nordeste/
Allow: /campeonatos/futebol-feminino/
Allow: /campeonatos/paulista/
Allow: /campeonatos/carioca/
Allow: /campeonatos/copa-america/
Allow: /mais-esportes/
Allow: /motor/formula-1/
Allow: /mais-esportes/basquete/
Allow: /mais-esportes/volei/
Allow: /mais-esportes/atletismo/
Allow: /esports/
Sitemap: https://www.gazetaesportiva.com/llms.txt

Sitemap: https://www.gazetaesportiva.com/sitemap_index.xml
Sitemap: https://www.gazetaesportiva.com/page-sitemap.xml
Sitemap: https://www.gazetaesportiva.com/category-sitemap.xml
Sitemap: https://www.gazetaesportiva.com/author-sitemap.xml
Sitemap: https://www.gazetaesportiva.com/special-sitemap.xml
Sitemap: https://www.gazetaesportiva.com/web-story-sitemap.xml

User-agent: *
Allow: /
Allow: /wp-content/uploads/
Allow: /wp-content/themes/
Allow: /wp-admin/admin-ajax.php
Allow: /feed/
Disallow: /wp-admin/
Disallow: /wp-includes/
Disallow: /wp-login/
Disallow: /cdn-cgi/
Disallow: /wp-content/plugins/
Disallow: /wp-content/cache/
Disallow: /wp-content/upgrade/
Disallow: /wp-login.php
Disallow: /wp-register.php
Disallow: /wp-json/
Disallow: /404
Disallow: /comments/
Disallow: /attachment/
Allow: /times/brasil/
Allow: /copa-do-mundo/
Allow: /campeonatos/brasileiro serie-a/
Allow: /campeonatos/brasileiro-serie-b/
Allow: /campeonatos/copa-sulamericana/
Allow: /campeonatos/libertadores-da-america/
Allow: /campeonatos/mundial-de-clubes-fifa/
Allow: /campeonatos/copa-do-brasil/
Allow: /campeonatos/copa-sao-paulo/
Allow: /campeonatos/copa-do-nordeste/
Allow: /campeonatos/futebol-feminino/
Allow: /campeonatos/paulista/
Allow: /campeonatos/carioca/
Allow: /campeonatos/copa-america/
Allow: /mais-esportes/
Allow: /motor/formula-1/
Allow: /mais-esportes/basquete/
Allow: /mais-esportes/volei/
Allow: /mais-esportes/atletismo/
Allow: /esports/

History

Changes recorded since June 2026.

No change recorded.

In context

Brazil
14.5% block at least one AI crawler
Behind Cloudflare
Yes