CrawlerPulse
CrawlerPulse / South America / Venezuela / eldiario.com

eldiario.com

eldiario.com · Venezuela · measured 8 Oct 2026

Google Search
Allowed
Google-Extended
Allowed
OpenAI
Allowed
Anthropic
Allowed
Perplexity
Allowed
Meta
Allowed
Common Crawl
Allowed
ByteDance
Allowed
Apple
Allowed
Amazon
Allowed

robots.txt

As read on 8 Oct 2026, 2,757 bytes. No rule names an AI crawler.

User-agent: *
Disallow: /wp-admin/
Allow:    /wp-admin/admin-ajax.php
Disallow: /blastdoor/
Disallow: membership-join/
Disallow: /uploads/complianz/
Disallow: /21916591732/
Allow: /wp-content/uploads/
Allow: /wp-includes/js/
Allow: /wp-content/themes/
Allow: /wp-content/plugins/
Disallow: /search/
Disallow: /*?s=*
Disallow: /feed/
Disallow: /comments/feed/
Disallow: /?feed=*
Disallow: /*?feed=*
Disallow: /autor/
Disallow: /etiquetas/
Disallow: /seccion/
Disallow: /nitropack_static/
Disallow: /experts/
Disallow: /*?replytocom=*
Disallow: /*?preview=*
Disallow: /preview/
Disallow: /print/
Disallow: /?attachment_id=*
Disallow: /xmlrpc.php
Disallow: /*?utm_*=*
Disallow: /*?fbclid=*
Disallow: /*?gclid=*
Disallow: /*?pk_campaign=*
Disallow: /*?pk_kwd=*
Disallow: /*?mc_cid=*
Disallow: /*?mc_eid=*
Disallow: /*?share=*
Disallow: /*?shared=*
Disallow: /*?ref_src=*
Disallow: /*?ref_url=*
Disallow: /*?orderby=*
Disallow: /*?filter_*=*
Disallow: /*?min_price=*
Disallow: /*?max_price=*
Disallow: /*?add-to-cart=*
Disallow: /*?nocache=*
Disallow: /*?amp=*
Disallow: /*?nonamp=*
Sitemap: https://eldiario.com/sitemap_index.xml
Sitemap: https://eldiario.com/news-sitemap.xml

User-agent: AdsBot-Google
Allow: /

User-agent: Googlebot-Image
Allow: /wp-content/uploads/

History

Changes recorded since June 2026.

No change recorded.

In context

Venezuela
9.2% block at least one AI crawler
Behind Cloudflare
Yes