CrawlerPulse
CrawlerPulse / North America / Curaçao / curacaonieuws.nu

Curacao Nieuws

curacaonieuws.nu · Curaçao · measured 8 Oct 2026

Google Search
Partial
Google-Extended
Partial
OpenAI
Partial
Anthropic
Partial
Perplexity
Partial
Meta
Partial
Common Crawl
Partial
ByteDance
Partial
Apple
Partial
Amazon
Partial

robots.txt

As read on 8 Oct 2026, 621 bytes. No rule names an AI crawler.

User-agent: *
Disallow: /wp-admin/
Disallow: /author/admin/
Disallow: /search/
Disallow: /category/
Disallow: /comments/
Disallow: /go/
Disallow: */?post_type=prp_reviews
Disallow: */feed/
Disallow: */feed
Disallow: /?feed=
Disallow: /comments/feed
Disallow: /feed/$
Disallow: /*/feed/$
Disallow: /*/feed/rss/$
Disallow: /*/trackback/$
Disallow: /*/*/feed/$
Disallow: /*/*/feed/rss/$
Disallow: /*/*/trackback/$
Disallow: /*/*/*/feed/$
Disallow: /*/*/*/feed/rss/$
Disallow: /*/*/*/trackback/$
Disallow: /*?*
Allow: /wp-admin/admin-ajax.php
Allow: /*.js
Allow: /*.css
Sitemap: /sitemap_index.xml

History

Changes recorded since June 2026.

No change recorded.

In context

Curaçao
20.0% block at least one AI crawler
Behind Cloudflare
Yes