superdeporte.es · Spain · Prensa Ibérica · measured 8 Oct 2026
As read on 8 Oct 2026, 2,956 bytes. 7 rule groups name AI crawlers; shown first.
User-agent: GPTBot Allow: /*-bc- Allow: /ideas/ Disallow: / User-agent: OAI-SearchBot Allow: /*-bc- Allow: /ideas/ Disallow: / User-agent: ChatGPT-User Allow: /*-bc- Allow: /ideas/ Disallow: / User-agent: PerplexityBot Allow: /*-bc- Allow: /ideas/ Disallow: / User-agent: ClaudeBot Allow: /*-bc- Allow: /ideas/ Disallow: / User-agent: Claude-Web Allow: /*-bc- Allow: /ideas/ Disallow: / User-agent: Google-CloudVertexBot Allow: / User-agent: 008 Disallow: /tic User-agent: UnisterBot Disallow: / User-agent: JikeSpider Disallow: / User-agent: Zealbot Disallow: / User-agent: WebStripper Disallow: / User-agent: WebCopier Disallow: / User-agent: Fetch Disallow: / User-agent: Teleport Disallow: / User-agent: HTTrack Disallow: / User-agent: magpie-crawler Disallow: / User-agent: MJ12bot Disallow: / User-agent: DotBot Disallow: / User-agent: spbot Disallow: / User-agent: BLEXBot Disallow: / User-agent: BUbiNG Disallow: / User-agent: Yandex Disallow: / User-agent: Baiduspider Disallow: / User-agent: Perplexity-User Allow: /*-bc- Allow: /ideas/ Disallow: / User-agent: Claude-User Allow: /*-bc- Allow: /ideas/ Disallow: / User-agent: Claude-SearchBot Allow: /*-bc- Allow: /ideas/ Disallow: / User-agent: AmazonAdBot Allow: / User-agent: * Allow: /*-bc- Allow: /*-sh/index.html$ Allow: /*-rm/index.html$ Disallow: /apuestas/ Disallow: /hemeroteca/buscador/ Disallow: /urdangarin/ Disallow: /caso-barcenas/ Disallow: /motogp/ Disallow: /declaracion-renta/ Disallow: /vuelta-espana/ Disallow: /esqui/ Disallow: /aniversario-muro-berlin/ Disallow: /el-rincon-de-los-suenos/ Disallow: /tendencias21/ Disallow: /guapisimas/ Disallow: /sucesion-papa/ Disallow: /renta-2012/ Disallow: /turismo/ Disallow: /coche-del-anyo/ Disallow: /encuestas/ Disallow: /concursos/ Disallow: /en-las-redes/ Disallow: */lidia-bedman* Disallow: /*?p= Disallow: /clip/ Disallow: /hemeroteca/ Disallow: /buscador/ Disallow: /apuestas/go/ Disallow: /apuestas/*/go/ Disallow: /apuestas///go/ Disallow: /apuestas/cgi-bin/ Disallow: /apuestas/*/attachment/ Disallow: /apuestas/tag/*/page/ Disallow: /apuestas/page/ Disallow: /apuestas/comments/ Disallow: /apuestas/xmlrpc.php Disallow: /apuestas/?attachment_id* Disallow: /apuestas/login Disallow: /apuestas/wp-admin/ Disallow: /apuestas/trackback/ Disallow: /apuestas/*trackback/ Disallow: /apuestas/trackback/ Disallow: /apuestas/*/trackback/ Disallow: /apuestas/*/trackback/ Disallow: /apuestas///trackback/ Disallow: /apuestas///*/trackback/ Disallow: /apuestas/*?s= Disallow: /fonts/ Disallow: /tags/$ Disallow: /tags/letra/ User-agent: Twitterbot Allow: / User-agent: facebookexternalhit Allow: / Sitemap: https://www.superdeporte.es/sitemapNews.xml Sitemap: https://www.superdeporte.es/sitemapMonth.xml Sitemap: https://www.superdeporte.es/sitemapSection.xml
Changes recorded since June 2026.
No change recorded.