CrawlerPulse
CrawlerPulse / South America / Chile / mega.cl

mega.cl

mega.cl · Chile · Mega · measured 8 Oct 2026

Google Search
Allowed
Google-Extended
Allowed
OpenAI
Allowed
Anthropic
Allowed
Perplexity
Allowed
Meta
Allowed
Common Crawl
Allowed
ByteDance
Allowed
Apple
Allowed
Amazon
Allowed

robots.txt

As read on 8 Oct 2026, 1,444 bytes. No rule names an AI crawler.

User-agent: *
Disallow: /404/
Disallow: /doubleclick/*
Disallow: /pocdai.html
Disallow: *page=*
Allow: *page=1$
Allow: *page=2$
Allow: *page=3$
Allow: *page=4$
Allow: *page=5$
Allow: *page=6$
Allow: *page=7$
Allow: *page=8$
Allow: *page=9$
Allow: *page=10$
Allow: *page=11$
Allow: *page=12$
Allow: *page=13$
Allow: *page=14$
Allow: *page=15$
Allow: *page=16$
Allow: *page=17$
Allow: *page=18$
Allow: *page=19$
Allow: *page=20$
Allow: *page=21$
Allow: *page=22$
Allow: *page=23$
Allow: *page=24$
Allow: *page=25$
Allow: *page=26$
Allow: *page=27$
Allow: *page=28$
Allow: *page=29$
Allow: *page=30$
Allow: *page=31$
Allow: *page=32$
Allow: *page=33$
Allow: *page=34$
Allow: *page=35$
Allow: *page=36$
Allow: *page=37$
Allow: *page=38$
Allow: *page=39$
Allow: *page=40$
Allow: *page=41$
Allow: *page=42$
Allow: *page=43$
Allow: *page=44$
Allow: *page=45$
Allow: *page=46$
Allow: *page=47$
Allow: *page=48$
Allow: *page=49$
Allow: *page=50$
Allow: *page=*&_escaped_fragment_=
Sitemap: https://www.mega.cl/sitemaps/sitemap-news.xml
Sitemap: https://www.mega.cl/sitemaps/sitemap-all-content.xml
Sitemap: https://www.mega.cl/sitemaps/sitemap-sections.xml
Sitemap: https://www.mega.cl/sitemaps/sitemap-index-content.xml
Sitemap: https://www.mega.cl/sitemaps/sitemap-index-video.xml
Sitemap: https://www.mega.cl/sitemaps/autores/sitemap-index-autores.xml
Sitemap: https://www.mega.cl/sitemaps/seccion-temas/sitemap-index-seccion-temas.xml

History

Changes recorded since June 2026.

No change recorded.

In context

Chile
2.7% block at least one AI crawler
Behind Cloudflare
No
Same group