CrawlerPulse
CrawlerPulse / Europe / Germany / noz.de

NOZ

noz.de · Germany · Neue Osnabrücker Zeitung GmbH & Co. KG · measured 8 Oct 2026

Google Search
Allowed
Google-Extended
Blocked
OpenAI
Blocked
Anthropic
Blocked
Perplexity
Blocked
Meta
Blocked
Common Crawl
Blocked
ByteDance
Blocked
Apple
Blocked
Amazon
Blocked

robots.txt

As read on 8 Oct 2026, 3,182 bytes. 1 rule group name AI crawlers; shown first.

User-agent: AI2Bot
User-agent: Amazonbot
User-agent: anthropic-ai
User-agent: Applebot-Extended
User-agent: Bytespider
User-agent: CCBot
User-agent: ChatGPT-User
User-agent: Claude-SearchBot
User-agent: Claude-User
User-agent: Claude-Web
User-agent: ClaudeBot
User-agent: CloudVertexBot
User-agent: cohere-ai
User-agent: cohere-training-data-crawler
User-agent: DeepSeek
User-agent: DeepSeekBot
User-agent: Devin
User-agent: Diffbot
User-agent: DuckAssistBot
User-agent: FacebookBot
User-agent: GPTBot
User-agent: Google-Extended
User-agent: ImagesiftBot
User-agent: Meta-ExternalAgent
User-agent: MistralAI-User
User-agent: OAI-SearchBot
User-agent: omgili
User-agent: omgilibot
User-agent: PerplexityBot
User-agent: PetalBot
User-agent: YouBot
Disallow: /

User-Agent: Mediapartners-Google
Disallow:

User-Agent: *
Disallow: /pagebuilding/
Disallow: /new-articles/
Disallow: /suche
Disallow: /cre-1.0/tracking/
Disallow: /etc/
Disallow: /section-
Disallow: /*itm_source=
Disallow: /*itm_medium=
Disallow: /*itm_content=
Disallow: /*itm_campaign=
Disallow: /*source_vicksweb=
Disallow: /*gaa_at=
Disallow: /*gaa_n=
Disallow: /*gaa_ts=
Disallow: /*gaa_sig=
Disallow: /*dicbo=
Disallow: /*cuid=
Disallow: /*MID=
Disallow: /*sfnsn=
Disallow: /*cx_testId=
Disallow: /*cx_testid=
Disallow: /*cx_testVariant=
Disallow: /*cx_testvariant=
Disallow: /*cx_artPos=
Disallow: /*cx_artpos=
Disallow: /*cx_experienceId=
Disallow: /*cx_experienceid=
Disallow: /*cx_experienceActionId=
Disallow: /*cx_experienceactionid=
Disallow: /*?q=
Disallow: /*suche=
Disallow: /*suchbegriff=
Disallow: /*page=
Disallow: /*seite=
Disallow: /*?s=
Disallow: /*&s=
Disallow: /*?k=
Disallow: /*&k=
Disallow: /*index.php
Disallow: /*bcpid=
Disallow: /*bckey=
Disallow: /*bclid=
Disallow: /*bctid=
Disallow: /*?live-blog-
Disallow: /*?live-news-
Disallow: /*?n-news-
Disallow: /*?y-news-
Disallow: /*?f-news-
Disallow: /*placeholder-for-image
Disallow: /*placeholder-for-technology-image
Disallow: /*editor=
Disallow: /*dsplz=
Disallow: /*?r=
Disallow: /*&r=
Disallow: /*location_key=
Disallow: /*womort=
Disallow: /*ref=
Disallow: /*artId=
Disallow: /*RUBRIKID=
Disallow: /*article-scroller=
Disallow: /*user_dimbildergalerie_pi1=
Disallow: /*noredirect=
Disallow: /*token=
Disallow: /*dslayout=
Disallow: /*dslayoutpost=
Disallow: /*previewAll=
Disallow: /*author=
Disallow: /*rel=
Disallow: /*categoryAlias=
Disallow: /*?set=
Disallow: /*&set=
Disallow: /*alternatehome=
Disallow: /*x-client=
Disallow: /*regGroupB=
Sitemap: https://www.noz.de/sitemap.xml
Sitemap: https://www.noz.de/sitemap/googleNewsList.xml
Sitemap: https://www.noz.de/sitemap/artikel/sitemap-current.xml

History

Changes recorded since June 2026.

No change recorded.

In context

Germany
71.7% block at least one AI crawler
Behind Cloudflare
No