haller-kreisblatt.de · Germany · Zeitungsverlag NEUE WESTFÄLISCHE GmbH & Co. KG · measured 8 Oct 2026
As read on 8 Oct 2026, 4,271 bytes. 15 rule groups name AI crawlers; shown first.
User-agent: OAI-SearchBot User-agent: GPTBot User-agent: ChatGPT-User Disallow: / User-agent: CCBot Disallow: / User-agent: Google-Extended Disallow: / User-agent: ClaudeBot User-agent: Claude-Web User-agent: anthropic-ai Disallow: / User-agent: cohere-ai User-agent: cohere-training-data-crawler Disallow: / User-agent: Meta-ExternalAgent User-agent: FacebookBot Disallow: / User-agent: Applebot-Extended Disallow: / User-agent: YouBot Disallow: / User-agent: Bytespider Disallow: / User-agent: Diffbot Disallow: / User-agent: PerplexityBot Disallow: / User-agent: DeepSeekBot User-agent: DeepSeek Disallow: / User-agent: ExtractorPro User-agent: Fasterfox User-agent: LinkextractorPro User-agent: LinkWalker User-agent: Openbot User-agent: rogerbot User-agent: searchpreview User-agent: True_Robot User-agent: URL Control User-agent: URL_Spider_Pro User-agent: BLEXBot User-agent: dotbot User-agent: magpie-crawler User-agent: SirdataBot User-agent: LCC User-agent: TurnitinBot User-agent: Timpibot User-agent: sentibot User-agent: ImagesiftBot Disallow: / User-agent: Meltwater User-agent: NewsNow User-agent: um-IC User-agent: ia_archiver User-agent: Baiduspider User-agent: Yeti User-agent: omgili User-agent: omgilibot Disallow: / User-agent: Amazonbot Disallow: /20* Sitemap: https://www.haller-kreisblatt.de/sitemap_hk_index.xml.gz Sitemap: https://www.haller-kreisblatt.de/sitemap_hk_index_news.xml.gz Sitemap: https://www.haller-kreisblatt.de/_retresco/sitemap/index.xml Sitemap: https://www.haller-kreisblatt.de/sitemap_author.xml User-agent: * Allow: / Disallow: /_em_cms/ Disallow: /service/abo_angebote/webabo_checkout Disallow: /_em_daten/_emag_data/hk/ Disallow: /tagsuche Disallow: /suche Allow: /_em_cms/globals/csslibs.php Allow: /_em_cms/globals/jslibs.php User-agent: Webzio-Extended Disallow: / User-agent: AhrefsBot User-agent: DataForSeoBot User-agent: SemrushBot User-agent: MJ12bot User-agent: backlink-check.de User-agent: BacklinkCrawler User-agent: SEODAT User-agent: SEOENGBot User-agent: SEOkicks-Robot User-agent: xovi Disallow: /
Changes recorded since June 2026.
No change recorded.