elperiodico.cat · Spain · measured 8 Oct 2026
As read on 8 Oct 2026, 1,656 bytes. 5 rule groups name AI crawlers; shown first.
User-agent: ChatGPT-User Disallow: / User-agent: GPTBot Disallow: / User-agent: ClaudeBot Disallow: / User-agent: Meta-ExternalAgent Disallow: / User-agent: PerplexityBot Disallow: / User-agent: 008 Disallow: / User-agent: UnisterBot Disallow: / User-agent: JikeSpider Disallow: / User-agent: Zealbot Disallow: / User-agent: WebStripper Disallow: / User-agent: WebCopier Disallow: / User-agent: Fetch Disallow: / User-agent: Teleport Disallow: / User-agent: HTTrack Disallow: / User-agent: magpie-crawler Disallow: / User-agent: MJ12bot Disallow: / User-agent: DotBot Disallow: / User-agent: spbot Disallow: / User-agent: BLEXBot Disallow: / User-agent: BUbiNG Disallow: / User-agent: Yandex Disallow: / User-agent: Baiduspider Disallow: / User-agent: Disallow: / Allow: /es/economia/ Allow: /es/extra/ Allow: /es/gente/ Allow: /es/tele/ Allow: /es/vida-y-estilo/ Allow: /es/ser-feliz/ Allow: /es/yotele/ User-agent: Twitterbot Allow: / User-agent: facebookexternalhit Allow: / User-agent: * Disallow: /es/includes/ Disallow: /cds-statics/esi/ Disallow: /*index.html$ Disallow: /es/newsletters/ Disallow: /es/verde-y-azul/ Disallow: /es/deportes/futbol/ Disallow: /es/noticias/sitemap* Disallow: /es/deportes/baloncesto/ Disallow: /es/podcast/mamarazzis/ Disallow: /es/component/cmp-detail-newsbytag/ Sitemap: https://www.elperiodico.com/es/google-news.xml Sitemap: https://www.elperiodico.com/es/sitemap-noticias.xml
Changes recorded since June 2026.
No change recorded.