CrawlerPulse
CrawlerPulse / South America / Colombia / dinero.com

Dinero

dinero.com · Colombia · Publicaciones Semana · measured 8 Oct 2026

Google Search
Allowed
Google-Extended
Allowed
OpenAI
Allowed
Anthropic
Allowed
Perplexity
Allowed
Meta
Allowed
Common Crawl
Allowed
ByteDance
Allowed
Apple
Allowed
Amazon
Allowed

robots.txt

As read on 8 Oct 2026, 1,265 bytes. 1 rule group name AI crawlers; shown first.

User-agent: PetalBot

User-agent: *
User-agent: Googlebot
User-agent: Googlebot-News
User-agent: Googlebot-Image
User-agent: Googlebot-Video
User-agent: Googlebot-Mobile
Allow: /sitemap/
Allow: /sitemap/*
Allow: /sitemaps/*
Allow: /rss/
Allow: /rss/*
Sitemap: https://www.semana.com/arc/outboundfeeds/news-sitemap-index/?outputType=xml
Sitemap: https://www.semana.com/arc/outboundfeeds/sitemap-index/?outputType=xml
Sitemap: https://www.semana.com/arc/outboundfeeds/rss/?outputType=xml
Sitemap: https://www.semana.com/arc/outboundfeeds/custom-news-sitemap-index-hard-news/?outputType=xml
Sitemap: https://www.semana.com/arc/outboundfeeds/custom-sitemap-index-evergreen/?outputType=xml
Disallow: /upload/images/
Disallow: /*GettyImages*/
Disallow: /*/ArticleAsync/
Disallow: /pf/api/v3/*
Disallow: /pf/resources/fonts/*
Disallow: /*200966608/Semana/
Disallow: /Modal/ModalPolicies.html
Disallow: /Modal/ModalHabeasData.html
Disallow: /revistaonline
Disallow: /jetsetonline
Disallow: /imprimir/
Disallow: /test/
Disallow: /data-user/
Disallow: /renovacion-suscripciones/
Disallow: /print
Disallow: /compare-results
Disallow: /proxy_u/
Disallow: /alerts/
Disallow: /renovacion-suscripciones
Disallow: /comunicaciontv
Disallow: /widget-2022/
Disallow: /widget-2026/

History

Changes recorded since June 2026.

No change recorded.

In context

Colombia
11.9% block at least one AI crawler
Behind Cloudflare
No
Same group