nordsee-zeitung.de · Germany · Nordsee-Zeitung GmbH · measured 8 Oct 2026
As read on 8 Oct 2026, 2,843 bytes. 15 rule groups name AI crawlers; shown first.
User-agent: GPTBot Disallow: / User-agent: ChatGPT-User Disallow: / User-agent: CCBot Disallow: / User-agent: Google-Extended Disallow: / User-agent: ClaudeBot Disallow: / User-agent: FacebookBot Disallow: / User-agent: meta-externalagent Disallow: / User-agent: DeepseekBot Disallow: / User-agent: Applebot-Extended Disallow: / User-agent: Bytespider Disallow: / User-agent: Timpibot Disallow: / User-agent: Diffbot Disallow: / User-agent: Omgili Disallow: / User-agent: OAI-SearchBot Disallow: / User-agent: Amazonbot Disallow: / User-agent: * Disallow: /User Disallow: /Dateien Disallow: /Nachrichten/Suche Disallow: /*?bPrint=true* Disallow: /Nachrichten/Archiv-Liste_*.html Disallow: /*/Zusammengefasst-*.html Disallow: /Zusammengefasst-*.html Disallow: /ScriptResource Disallow: /WebResource User-agent: backlink-check.de Disallow: / User-agent: BacklinkCrawler Disallow: / User-agent: ExtractorPro Disallow: / User-agent: Fasterfox Disallow: / User-agent: LinkextractorPro Disallow: / User-agent: LinkWalker Disallow: / User-agent: MJ12bot Disallow: / User-agent: Openbot Disallow: / User-agent: rogerbot Disallow: / User-agent: searchpreview Disallow: / User-agent: SemrushBot Disallow: / User-agent: SEODAT Disallow: / User-agent: SEOENGBot Disallow: / User-agent: SEOkicks-Robot Disallow: / User-agent: True_Robot Disallow: / User-agent: URL Control Disallow: / User-agent: URL_Spider_Pro Disallow: / User-agent: xovi Disallow: / User-agent: um-IC Disallow: / User-agent: CloudVertexBot Disallow: / User-agent: cohere-training-data-crawler Disallow: / User-agent: PanguBot Disallow: / User-agent: AI2Bot Disallow: / User-agent: Webzio-Extended Disallow: / User-agent: Perplexity-User Disallow: / User-agent: Claude-SearchBot Disallow: / User-agent: Meta-ExternalFetcher Disallow: / User-agent: Applebot Disallow: / Crawl-Delay: 2 Sitemap: https://www.nordsee-zeitung.de/Sitemap_Index.xml.gz
Changes recorded since June 2026.
No change recorded.