oglobo.globo.com · Brazil · Globo · measured 8 Oct 2026
As read on 8 Oct 2026, 3,277 bytes. 17 rule groups name AI crawlers; shown first.
User-agent: GPTBot Disallow: / User-agent: CCBot Disallow: / User-agent: Google-Extended Disallow: / User-agent: Omgilibot Disallow: / User-agent: anthropic-ai Disallow: / User-agent: cohere-ai Disallow: / User-agent: FacebookBot Disallow: / User-agent: Bytespider Disallow: / User-agent: ChatGPT-User Allow: /conteudo-de-marca/ Disallow: / User-agent: PerplexityBot Allow: /conteudo-de-marca/ Disallow: / User-agent: OAI-SearchBot Allow: /conteudo-de-marca/ Disallow: / User-agent: Claude-User User-agent: ClaudeBot User-agent: Claude-SearchBot Allow: /conteudo-de-marca/ Disallow: / User-agent: Claude-Web Allow: /conteudo-de-marca/ Disallow: / User-agent: ChatGPT-User/2.0 Allow: /conteudo-de-marca/ Disallow: / User-agent: MistralAI-User/1.0 Disallow: / User-agent: MistralAI-User Disallow: / User-agent: DeepSeekBot Disallow: / User-Agent: * Disallow: /_inc/ Disallow: /_inc_novo/ Disallow: /_img/ Disallow: /skins/ Disallow: /in/ Disallow: /ece_incoming/ Disallow: /inc/ Disallow: /img/ Disallow: /servicos/ Disallow: /content/ Disallow: /oglobo-mobile/ Disallow: /config/ Disallow: /email_marketing/ Disallow: /email_mkt/ Disallow: /rss.xml Disallow: /*.json Disallow: */ALTERNATES/* Disallow: */BINARY/* Disallow: /*?word* Disallow: /*?anyWord* Disallow: /*?noneWord* Disallow: /*?exactWord* Disallow: /*?decade* Disallow: /*?year* Disallow: /*?month* Disallow: /*?day* Disallow: /busca/ Disallow: /beta/ Allow: /in/*.jpg Allow: /in/*.JPG Allow: /in/*.jpeg Allow: /in/*.JPEG Allow: /in/*.png Allow: /in/*.PNG Allow: /in/*.gif Allow: /in/*.GIF Allow: /in/*.tif Allow: /in/*.TIF Allow: /in/*.bmp Allow: /in/*.BMP User-Agent: Googlebot-News Allow: * Sitemap: https://oglobo.globo.com/sitemap/oglobo/news.xml Sitemap: https://oglobo.globo.com/sitemap/topic/oglobo/sitemap.xml Sitemap: https://oglobo.globo.com/sitemap/oglobo/sitemap.xml Sitemap: https://oglobo.globo.com/sitemap/home/oglobo/sitemap.xml Sitemap: https://oglobo.globo.com/sitemap/section/oglobo/sitemap.xml User-agent: ai-sdk/6.0.116 runtime/browser Allow: /beta User-agent: AI-Powered-Bot Disallow: / User-agent: SabiáBot Disallow: / User-agent: Grok Disallow: / User-agent: GrokBot Disallow: / User-agent: GrokAI Disallow: / User-agent: xAI Disallow: / User-agent: Copilot-LLM Disallow: / User-agent: Copilot Disallow: / User-agent: CopilotAI Disallow: / User-agent: CopilotBot Disallow: / User-agent: Claude-Code Disallow: / User-agent: MyCentralAIScraperBot Disallow: / User-agent: ChatGPT Operator Disallow: / User-agent: Perplexity-User/1.0 Disallow: / User-agent: Perplexity-User Disallow: / User-agent: DuckAssistBot Disallow: / User-agent: cohere-training-data-crawler Disallow: / User-agent: AI2Bot Disallow: / User-agent: Ai2Bot-Dolma Disallow: / User-agent: Big Sur AI Disallow: / User-agent: DigitalOceanGenAICrawler Disallow: / User-agent: SBIntuitionsBot Disallow: / User-agent: LINER Bot Disallow: / User-agent: PanguBot Disallow: / User-agent: img2dataset Disallow: /
Changes recorded since June 2026.
No change recorded.