CrawlerPulse
CrawlerPulse / Europe / Ireland / irishracing.com

Irishracing

irishracing.com · Ireland · measured 9 Oct 2026

Google Search
Allowed
Google-Extended
Allowed
OpenAI
Allowed
Anthropic
Allowed
Perplexity
Allowed
Meta
Allowed
Common Crawl
Allowed
ByteDance
Allowed
Apple
Allowed
Amazon
Allowed

robots.txt

As read on 9 Oct 2026, 1,008 bytes. 1 rule group name AI crawlers; shown first.

User-agent: PetalBot
User-agent: AhrefsBot
User-agent: SemrushBot
User-agent: BLEXBot
User-agent: YandexBot
User-agent: ScooperBot
User-agent: DotBot
User-agent: MTRobot
Disallow: /

Sitemap: https://www.irishracing.com/sitemapindex.xml
Sitemap: https://www.irishracing.com/newssitemap.xml

User-agent: *
Disallow: /news?headline=Fine-and-ban-for-Dawson-after-positive-drugs-test&prid=63274
Disallow: /news?prid=63274

User-agent: *
Disallow: /IrelandcomRacingSection/
Disallow: /activities/
Disallow: /transport/
Disallow: /entertainment/
Disallow: /destinations/
Disallow: /accomodation/
Disallow: /food/
Disallow: /cards/v5card*.htm
Disallow: /punchestown201*.*
Disallow: /punchestownanl*
Disallow: /punchestownbet*
Disallow: /punchestowntrn*
Disallow: /punchestownnewsitem*
Disallow: /Punchestown-Fest*.html
Disallow: /galway201*.*
Disallow: /galwaybet*
Disallow: /galwayanl*
Disallow: /dpirs*.htm
Disallow: /v3*.htm
Disallow: /v4*.htm
Disallow: /v5*.htm
Disallow: /fo/

History

Changes recorded since June 2026.

No change recorded.

In context

Ireland
57.1% block at least one AI crawler
Behind Cloudflare
Yes