CrawlerPulse
CrawlerPulse / Europe / Austria / nachrichten.at

Oberösterreichische Nachrichten

nachrichten.at · Austria · OÖN Redaktion GmbH & Co KG · measured 8 Oct 2026

Google Search
Allowed
Google-Extended
Blocked
OpenAI
Blocked
Anthropic
Blocked
Perplexity
Blocked
Meta
Blocked
Common Crawl
Blocked
ByteDance
Blocked
Apple
Blocked
Amazon
Blocked

robots.txt

As read on 8 Oct 2026, 2,669 bytes. 22 rule groups name AI crawlers; shown first.

User-agent: Amazonbot
Disallow: /

User-agent: anthropic-ai
Disallow: /

User-agent: Applebot-Extended
Disallow: /

User-agent: Bytespider
Disallow: /

User-agent: CCBot
Disallow: /

User-agent: ChatGPT-User
Disallow: /

User-agent: Claude-Web
Disallow: /

User-agent: ClaudeBot
Disallow: /

User-agent: cohere-ai
Disallow: /

User-agent: Diffbot
Disallow: /

User-agent: FacebookBot
Disallow: /

User-agent: Google-Extended
Disallow: /

User-agent: GPTBot
Disallow: /

User-agent: ImagesiftBot
Disallow: /

User-agent: meta-externalagent
Disallow: /

User-agent: OAI-SearchBot
Disallow: /

User-agent: omgili
Disallow: /

User-agent: omgilibot
Disallow: /

User-agent: PerplexityBot
Disallow: /

User-agent: PetalBot
Disallow: /

User-agent: Timpibot
Disallow: /

User-agent: YouBot
Disallow: /
Sitemap: https://www.nachrichten.at/index.sitemap.xml
Sitemap: https://www.nachrichten.at/google-news.sitemap.xml

User-agent: *
Allow: /_/scripts/
Allow: /_/styles/
Allow: /_/sendmail.html*
Allow: /nachrichten/newsletter/bestellen/
Disallow: /_/
Disallow: /_CPiX/
Disallow: /_fWS/json/customer/0/getLoginLogoutBoxHtml/
Disallow: /_fWS/json/layout/1072/getLayout/
Disallow: /_fWS/json/Pinboard/0/check/
Disallow: /_fWS/json/Ticker/0/getNewPostsCount/
Disallow: /_fWS/json/Customer_Topic/0/getCustomerTopicStatus/
Disallow: /_fWS/json/customer_topic/0/getCount/
Disallow: /_fWS/json/Rating/0/getRatingData/
Disallow: /_fWS/json/Serverchannel/0/process/
Disallow: /_fWS/json/Comment/
Disallow: /import/
Disallow: /abfall/
Disallow: /dcarchiv/
Disallow: /archiv/
Disallow: /forum/
Disallow: /nachrichten/epaper/
Disallow: /layouts/
Disallow: /anzeigen/relaunch/
Disallow: /intranet/
Disallow: /babyweb/
Disallow: /online/
Disallow: /_ipad_/
Disallow: /scripts/
Disallow: /scripts_ssl/
Disallow: /nachrichten/fotogalerien/bildergalerie/cme48500*
Disallow: /storage/scl/bildupload/leserfotos/aktionen/*
Disallow: /storage/scl/artikelbilder/ratgeber/354516_*
Disallow: /storage/scl/artikelbilder/oberoesterreich/935645_*
Disallow: /storage/scl/import/alfa/regional/526678_*
Disallow: /storage/scl/import/alfa/menschen/129657_*
Disallow: /storage/scl/import/alfa/regional/1009151_*
Disallow: /storage/scl/import/alfa/innviertel/381125_*
Disallow: /storage/pic/import/alfa/innviertel/378073_*
Disallow: /*,2043953
Disallow: /storage/med/download/286451_*
Disallow: /nachrichten/fotogalerien/*92996651111111111111*
Disallow: /nachrichten/bilder_des_tages/*92996651111111111111*
Disallow: /nachrichten/newsletter/

User-agent: DuckAssistBot
Disallow: /

User-agent: PanguBot
Disallow: /

User-agent: Sidetrade indexer bot
Disallow: /

User-agent: Webzio-Extended
Disallow: /

History

Changes recorded since June 2026.

No change recorded.

In context

Austria
32.9% block at least one AI crawler
Behind Cloudflare
Yes
Same group