valencianoticias.com · Spain · measured 8 Oct 2026
As read on 8 Oct 2026, 2,750 bytes. 1 rule group name AI crawlers; shown first.
User-agent: PetalBot Disallow: / User-agent: * Allow: /wp-content/uploads/ Allow: /*.js$ Allow: /*.css$ Allow: /wp-content/themes/*.css$ Allow: /wp-content/themes/*.js$ Allow: /wp-content/plugins/*.css$ Allow: /wp-content/plugins/*.js$ Disallow: /cgi-bin/ Disallow: /wp-admin/ Disallow: /wp-includes/ Disallow: /?s= Disallow: /*?replytocom Disallow: /author/ Disallow: /*?utm_source= Disallow: /*?fbclid= Disallow: /feed/ Disallow: /comments/feed/ Disallow: /*/trackback/ User-agent: Googlebot Allow: / User-agent: Googlebot-Image Allow: /wp-content/uploads/ User-agent: Adsbot-Google Allow: / User-agent: Googlebot-Mobile Allow: / User-agent: Bingbot Crawl-delay: 5 User-agent: AhrefsBot Disallow: / User-agent: SemrushBot Disallow: / User-agent: MJ12bot Disallow: / User-agent: DotBot Disallow: / User-agent: MauiBot Disallow: / User-agent: MSIECrawler Disallow: / User-agent: WebCopier Disallow: / User-agent: HTTrack Disallow: / User-agent: Microsoft.URL.Control Disallow: / User-agent: libwww Disallow: / User-agent: Baiduspider Disallow: / User-agent: GurujiBot Disallow: / User-agent: hl_ftien_spider Disallow: / User-agent: sogou spider Disallow: / User-agent: Yeti Disallow: / User-agent: YodaoBot Disallow: / Sitemap: https://valencianoticias.com/sitemap_index.xml
Changes recorded since June 2026.
No change recorded.