correioweb.com.br · Brazil · measured 8 Oct 2026
As read on 8 Oct 2026, 984 bytes. No rule names an AI crawler.
User-agent: * Disallow: /autor/* Disallow: /busca/* Disallow: /tags/* Disallow: /related/* Disallow: /_templates/ Disallow: /_temp/ Disallow: /includes/ Disallow: /static/ Disallow: /src/ Disallow: /imagens/ Disallow: /cdn/ Disallow: /assets/ Disallow: /_files/ Disallow: /*.pdf$ Disallow: /*.json$ Disallow: /search/* Disallow: /teste-*.html$ Allow: /*.jpg Allow: /*.JPG Allow: /*.jpeg Allow: /*.JPEG Allow: /*.png Allow: /*.PNG Allow: /*.gif Allow: /*.GIF User-agent:Facebot Allow: /imagens/ Allow: /_midias/ User-agent:facebookexternalhit Allow: /imagens/ Allow: /_midias/ User-agent: Googlebot-News Allow: * User-agent: Yandex Disallow: / User-agent: Slurp Disallow: / User-agent: Baidoospider Disallow: /
Changes recorded since June 2026.
No change recorded.