CrawlerPulse
CrawlerPulse / North America / Mexico / eleconomista.com.mx

El Economista Mexico

eleconomista.com.mx · Mexico · measured 8 Oct 2026

Google Search
Allowed
Google-Extended
Allowed
OpenAI
Allowed
Anthropic
Allowed
Perplexity
Allowed
Meta
Allowed
Common Crawl
Allowed
ByteDance
Allowed
Apple
Allowed
Amazon
Allowed

robots.txt

As read on 8 Oct 2026, 386 bytes. No rule names an AI crawler.

User-agent: *
Disallow: /89775457
Disallow: /buscar
Disallow: */video-youtube/*
Disallow: /contenidos/
Disallow: /redirector.jsp?t
Disallow: /__export/
Disallow: /export/*
Disallow: /candidate.txt
Disallow: /page/listing-listing-more-news*
Disallow: /_req/
Disallow: /_req/*
Disallow: /page/listing-*
Disallow: *mrfhud=true
Disallow: */capitalhumano/
Disallow: /load-mediastream-video/

History

Changes recorded since June 2026.

No change recorded.

In context

Mexico
11.1% block at least one AI crawler
Behind Cloudflare
Yes