CrawlerPulse
CrawlerPulse / North America / Honduras / criterio.hn

[Criterio.hn]

criterio.hn · Honduras · [Criterio.hn](http://Criterio.hn) · measured 8 Oct 2026

Google Search
Allowed
Google-Extended
Blocked
OpenAI
Blocked
Anthropic
Blocked
Perplexity
Allowed
Meta
Allowed
Common Crawl
Allowed
ByteDance
Allowed
Apple
Blocked
Amazon
Allowed

robots.txt

As read on 8 Oct 2026, 4,278 bytes. 10 rule groups name AI crawlers; shown first.

User-agent: OAI-SearchBot
Allow: /

User-agent: ChatGPT-User
Allow: /

User-agent: PerplexityBot
Allow: /

User-agent: Claude-Web
Allow: /

User-agent: GPTBot
Disallow: /

User-agent: Google-Extended
Disallow: /

User-agent: ClaudeBot
Disallow: /

User-agent: Anthropic-ai
Disallow: /

User-agent: Applebot-Extended
Disallow: /

User-agent: PetalBot
Disallow: /

User-agent: *
Disallow: /wp-admin/
Allow: /wp-admin/admin-ajax.php
Disallow: /wp-includes/
Disallow: /xmlrpc.php
Disallow: /wp-login.php
Disallow: /wp-register.php
Disallow: /readme.html
Disallow: /license.txt
Disallow: /feed/
Disallow: /feed/$
Disallow: /comments/feed/
Disallow: /trackback/
Disallow: */trackback/
Disallow: */feed/
Disallow: */comments/
Disallow: /wp-comments/
Disallow: /wp-feed/
Disallow: /wp-trackback/
Disallow: */?author=*
Disallow: */author/*
Disallow: /author/
Disallow: */replytocom=
Disallow: *?attachment_id=
Disallow: /privacy-policy/
Allow: /*/*.css
Allow: /*/*.js
Allow: /ads.txt

User-agent: AhrefsBot
Disallow: /

User-agent: SemrushBot
Disallow: /

User-agent: SemrushBot-SA
Disallow: /

User-agent: MJ12bot
Disallow: /

User-agent: DotBot
Disallow: /

User-agent: Rogerbot
Disallow: /

User-agent: Linkdexbot
Disallow: /

User-agent: SeznamBot
Disallow: /

User-agent: Barkrowler
Disallow: /

User-agent: BlexBot
Disallow: /

User-agent: ZoominfoBot
Disallow: /

User-agent: Sogou spider
Disallow: /

User-agent: Baiduspider
Disallow: /
Sitemap: https://criterio.hn/sitemap_index.xml
Sitemap: https://criterio.hn/news-sitemap.xml

History

Changes recorded since June 2026.

No change recorded.

In context

Honduras
5.6% block at least one AI crawler
Behind Cloudflare
No