hispanidad.com · Spain · measured 8 Oct 2026
As read on 8 Oct 2026, 3,199 bytes. 10 rule groups name AI crawlers; shown first.
User-agent: Bytespider Disallow: / User-agent: PetalBot Disallow: / User-agent: omgilibot Disallow: / User-agent: GPTBot Disallow: / User-agent: ClaudeBot Disallow: / User-agent: anthropic-ai Disallow: / User-agent: CCBot Disallow: / User-agent: Google-Extended Disallow: / User-agent: Applebot-Extended Disallow: / User-agent: meta-externalagent Disallow: / User-agent: * sitemap: https://www.hispanidad.com/uploads/mapsites/sitemap_hispanidad.xml Sitemap: https://www.hispanidad.com/news-sitemap.xml Disallow: /_call Disallow: /*?tag* Disallow: /buscador.html* Disallow: /confidencial/alberto-de-rosa-ceo-de-ribera-salud-decepciona-a-centene-quieren-irse-de-espana_12004800_102.html Disallow: /sin-categoria/la-seleccion-espanola-con-el-rabo-entre-las-piernas-huye-como-las-gallinas_1099916_102.html User-agent: um-IC Disallow: / User-agent: SemrushBot Disallow: / User-agent: FairShare Disallow: / User-agent: MetaURI Disallow: / User-agent: nabot Disallow: / User-agent: NaverBot Disallow: / User-agent: Kimengi/nineconnections.com Disallow: / User-agent: Kimengi Disallow: / User-agent: DigExt Disallow: / User-agent: DTS Agent Disallow: / User-agent: dloader Disallow: / User-agent: dloader(NaverRobot) Disallow: / User-agent: magpie-crawler Disallow: / User-agent: MJ12bot Disallow: / User-agent: AhrefsBot Disallow: / User-agent: Exabot Disallow: / User-agent: QuerySeekerSpider Disallow: / User-agent: UniversalFeedParser Disallow: / User-agent: Flamingo_SearchEngine Disallow: / User-agent: Livelapbot Disallow: / User-agent: Wotbot Disallow: / User-agent: Wotbox Disallow: / User-agent: BIXOCRAWLER Disallow: / User-agent: proximic Disallow: / User-agent: Genieo Disallow: / User-agent: Heritrix Disallow: / User-agent: rogerbot Disallow: / User-agent: spbot Disallow: / User-agent: trendictionbot Disallow: / User-agent: uMBot-LN Disallow: / User-agent: SEOkicks-Robot Disallow: / User-agent: nutch Disallow: / User-agent: crawler4j Disallow: / User-agent: dotbot Disallow: / User-agent: heritrix/3.3.0 Disallow: / User-agent: heritrix Disallow: / User-agent: Moreover Disallow: / User-agent: Cliqzbot Disallow: / User-agent: 008 Disallow: / User-agent: UnisterBot Disallow: / User-agent: JikeSpider Disallow: / User-agent: sitecheck.internetseer.com Disallow: / User-agent: Zealbot Disallow: / User-agent: MSIECrawler Disallow: / User-agent: SiteSnagger Disallow: / User-agent: WebStripper Disallow: / User-agent: WebCopier Disallow: / User-agent: Fetch Disallow: / User-agent: Offline Explorer Disallow: / User-agent: Teleport Disallow: / User-agent: TeleportPro Disallow: / User-agent: WebZIP Disallow: / User-agent: linko Disallow: / User-agent: HTTrack Disallow: / User-agent: Microsoft.URL.Control Disallow: / User-agent: larbin Disallow: / User-agent: libwww Disallow: / User-agent: ZyBORG Disallow: / User-agent: Download Ninja Disallow: / User-agent: Maxthon Disallow: / User-agent: CNCDialer Disallow: / User-agent: cohere-training-data-crawler Disallow: /
Changes recorded since June 2026.
No change recorded.