CrawlerPulse
CrawlerPulse / South America / Colombia / areacucuta.com

areacucuta.com

areacucuta.com · Colombia · measured 8 Oct 2026

Google Search
Allowed
Google-Extended
Allowed
OpenAI
Allowed
Anthropic
Allowed
Perplexity
Allowed
Meta
Allowed
Common Crawl
Allowed
ByteDance
Allowed
Apple
Allowed
Amazon
Allowed

robots.txt

As read on 8 Oct 2026, 559 bytes. No rule names an AI crawler.

User-agent: *
Disallow: /wp-admin/
Disallow: /wp-includes/
Disallow: /wp-content/plugins/
Disallow: /wp-content/themes/
Disallow: /trackback/
Disallow: /xmlrpc.php
Disallow: /search/
Disallow: /*/page/
Disallow: /*?nomobile
Disallow: /*?amp=
Disallow: /*?utm_source=
Disallow: /*?ref=
Disallow: /*/feed/
Disallow: /author/

User-agent: AhrefsBot
Allow: /
Crawl-delay: 2
Sitemap: https://www.areacucuta.com/sitemaps.xml

History

Changes recorded since June 2026.

No change recorded.

In context

Colombia
11.9% block at least one AI crawler
Behind Cloudflare
Yes