CrawlerPulse
CrawlerPulse / Europe / Spain / naciodigital.cat

naciodigital.cat

naciodigital.cat · Spain · measured 8 Oct 2026

Google Search
Allowed
Google-Extended
Allowed
OpenAI
Allowed
Anthropic
Allowed
Perplexity
Allowed
Meta
Allowed
Common Crawl
Allowed
ByteDance
Allowed
Apple
Allowed
Amazon
Allowed

robots.txt

As read on 8 Oct 2026, 511 bytes. 1 rule group name AI crawlers; shown first.

User-agent: PetalBot
Disallow: /

User-agent: sentibot
Disallow: /

User-agent: SentiBot
Disallow: /

User-agent: *
Allow: /
Disallow: /?s=*
Disallow: /web/*
Disallow: /api/*
Sitemap: https://naciodigital.cat/sitemaps/sitemap-news.xml
Sitemap: https://naciodigital.cat/sitemaps/sitemap-hemeroteca.xml
Sitemap: https://naciodigital.cat/sitemaps/categories-sitemap.xml
Sitemap: https://naciodigital.cat/sitemaps/authors-sitemap.xml
Sitemap: https://naciodigital.cat/sitemaps/tags-sitemap.xml

History

Changes recorded since June 2026.

No change recorded.

In context

Spain
34.1% block at least one AI crawler
Behind Cloudflare
No