CrawlerPulse
CrawlerPulse / North America / United States / calonews.com

Calo News

calonews.com · United States · Latino Media Collaborative · measured 8 Oct 2026

Google Search
Allowed
Google-Extended
Allowed
OpenAI
Allowed
Anthropic
Allowed
Perplexity
Allowed
Meta
Allowed
Common Crawl
Allowed
ByteDance
Allowed
Apple
Allowed
Amazon
Allowed

robots.txt

As read on 8 Oct 2026, 1,215 bytes. No rule names an AI crawler.

User-agent: *
Disallow: /tncms/tracking/
Disallow: /_services/
Disallow: /style_guide/
Disallow: /test/
Disallow: /tncms/gtm/
Disallow: /tncms/dmp/
Disallow: /tncms/messaging/
Disallow: /tncms/tax/
Disallow: /tncms/openid2/
Disallow: /tncms/weather/
Disallow: /tncms/csrf/
Disallow: /tncms/track/
Disallow: /tncms/media/
Disallow: /tncms/webservice/
Disallow: /tncms/search/
Disallow: /tncms/counter/
Disallow: /tncms/openweb/*
Disallow: /tncms/auth/
Disallow: /tncms/block/
Disallow: /tncms/admin/
Disallow: /tncms/user/
Disallow: /users/admin/
Disallow: /users/*/?
Disallow: /content/tncms/assets/v3/form/
Disallow: /content/tncms/form/
Disallow: /content/tncms/
Disallow: /tncms/disqus/
Disallow: /calo_pages/*action=srch
Disallow: /tncms/calendar/
Disallow: /calendar/search/
Sitemap: https://www.calonews.com/sitemap.xml
Sitemap: https://www.calonews.com/tncms/sitemap/editorial.xml
Sitemap: https://www.calonews.com/tncms/sitemap/editorial.xml?year=2022
Sitemap: https://www.calonews.com/tncms/sitemap/editorial.xml?year=2023
Sitemap: https://www.calonews.com/tncms/sitemap/editorial.xml?year=2024
Sitemap: https://www.calonews.com/tncms/sitemap/editorial.xml?year=2025

History

Changes recorded since June 2026.

No change recorded.

In context

United States
63.2% block at least one AI crawler
Behind Cloudflare
No