Palencia en la Red

palenciaenlared.es · Spain · measured 8 Oct 2026

Google Search

Allowed

Google-Extended

Allowed

OpenAI

Allowed

Anthropic

Allowed

Perplexity

Allowed

robots.txt

As read on 8 Oct 2026, 1,439 bytes. No rule names an AI crawler.

User-agent: *
Allow: /wp-content/uploads/
Allow: /wp-content/*.js
Allow: /wp-content/*.css
Allow: /wp-includes/*.js
Allow: /wp-includes/*.css
Allow: /wp-content/themes/
Allow: /wp-content/cache/
Allow: /wp-content/gallery/
Allow: /wp-content/uploads/*.jpg
Allow: /wp-content/uploads/*.jpeg
Allow: /wp-content/uploads/*.png
Allow: /wp-content/uploads/*.gif
Allow: /wp-content/uploads/*.webp
Allow: /wp-content/uploads/*.avif
Disallow: /cgi-bin/
Disallow: /wp-admin/
Disallow: /wp-content/plugins/
Disallow: /wp-includes/
Disallow: /*/attachment/
Disallow: /tag/*/page/
Disallow: /tag/*/feed/
Disallow: /page/
Disallow: /comments/
Disallow: /xmlrpc.php
Disallow: /?attachment_id*
Disallow: /?s=
Disallow: /search
Disallow: /trackback
Disallow: /*trackback
Disallow: /*trackback*
Disallow: /*/trackback
Sitemap: https://www.palenciaenlared.es/sitemap-news.xml
Sitemap: https://www.palenciaenlared.es/sitemap_index.xml

User-agent: Googlebot-Image
Disallow:

User-agent: AdsBot-Google
Disallow:

User-agent: Bingbot
Disallow:

History

Changes recorded since June 2026.

No change recorded.

In context

Spain

34.1% block at least one AI crawler

Behind Cloudflare

Yes