CrawlerPulse
CrawlerPulse / Europe / Austria / industriemagazin.at

industriemagazin.at

industriemagazin.at · Austria · measured 8 Oct 2026

Google Search
Allowed
Google-Extended
Allowed
OpenAI
Allowed
Anthropic
Allowed
Perplexity
Allowed
Meta
Allowed
Common Crawl
Allowed
ByteDance
Allowed
Apple
Allowed
Amazon
Blocked

robots.txt

As read on 8 Oct 2026, 773 bytes. 1 rule group name AI crawlers; shown first.

User-agent: AmazonBot
Disallow: /

sitemap: https://industriemagazin.at/sitemaps-2-sitemap.xml
sitemap: https://industriemagazin.at/news.xml

User-agent: SemrushBot
Disallow: /

User-agent: *
Disallow: /cpresources/
Disallow: /vendor/
Disallow: /.env
Disallow: /cache/
Disallow: /api$
Disallow: /weka/user/loginstate$
Disallow: /rss.xml$
Disallow: /*?x-craft-live-preview=
Disallow: /*?x-craft-preview=
Disallow: /*?*&x-craft-live-preview=
Disallow: /*?*&x-craft-preview=
Disallow: /*?cachepriming=
Disallow: /*?*&cachepriming=
Disallow: /*?primingcache=
Disallow: /*?*&primingcache=
Disallow: /*?pc=
Disallow: /*?*&pc=

History

Changes recorded since June 2026.

No change recorded.

In context

Austria
32.9% block at least one AI crawler
Behind Cloudflare
Yes