CrawlerPulse
CrawlerPulse / South America / Brazil / omelete.com.br

Omelete Company

omelete.com.br · Brazil · measured 8 Oct 2026

Google Search
Allowed
Google-Extended
Allowed
OpenAI
Allowed
Anthropic
Allowed
Perplexity
Allowed
Meta
Allowed
Common Crawl
Allowed
ByteDance
Allowed
Apple
Allowed
Amazon
Allowed

robots.txt

As read on 8 Oct 2026, 700 bytes. No rule names an AI crawler.

User-agent: *
Disallow: /busca
Disallow: /todas?*
Disallow: /noticias?*
Disallow: /listas?*
Disallow: /criticas?*
Disallow: /webstories?*
Disallow: /busca?*
Disallow: /search?*
Disallow: *?next=*
Disallow: *?section=*
Disallow: *?pagina=*
Disallow: *?page=*
Disallow: *&pagina=*
Disallow: *&page=*
Disallow: /_scroll/
Disallow: /home-omelete
Disallow: /amp/
Disallow: /embed/
Disallow: /preview/
Disallow: *?ordem=*
Disallow: *?sort=*

User-agent: baiduspider
Disallow: /

User-agent: yandex
Disallow: /

User-agent: ysearch
Disallow: /

User-agent: Slurp
Disallow: /

User-agent: sogou
Disallow: /
Sitemap: https://www.omelete.com.br/sitemap.xml
Sitemap: https://www.omelete.com.br/sitemap-news.xml

History

Changes recorded since June 2026.

No change recorded.

In context

Brazil
14.5% block at least one AI crawler
Behind Cloudflare
No