CrawlerPulse
CrawlerPulse / Europe / Spain / alhaurindelatorre.com

Alhaurín de la Torre

alhaurindelatorre.com · Spain · Alhaurín de la Torre - Alhaurín de la Torre Diario Independiente · measured 8 Oct 2026

Google Search
Allowed
Google-Extended
Allowed
OpenAI
Allowed
Anthropic
Allowed
Perplexity
Allowed
Meta
Allowed
Common Crawl
Allowed
ByteDance
Allowed
Apple
Allowed
Amazon
Allowed

robots.txt

As read on 8 Oct 2026, 645 bytes. No rule names an AI crawler.

User-agent: AhrefsBot
Disallow: /

User-agent: SemrushBot
Disallow: /

User-agent: *
Disallow: /*?amp=1
Disallow: /*?noamp=mobile
Disallow: /*?replytocom=
Disallow: /*?share=
Disallow: /*?fbclid=
Disallow: /*?utm_source=
Disallow: /*?utm_medium=
Disallow: /*?utm_campaign=
Allow: /
Sitemap: https://www.alhaurindelatorre.com/sitemap_index.xml

History

Changes recorded since June 2026.

No change recorded.

In context

Spain
34.1% block at least one AI crawler
Behind Cloudflare
No