hessenschau.de · Germany · measured 9 Oct 2026
As read on 9 Oct 2026, 2,686 bytes. 12 rule groups name AI crawlers; shown first.
User-agent: applebot-extended Disallow: / User-agent: bytespider Disallow: / User-agent: ccbot Disallow: / User-agent: claudebot Disallow: / User-agent: google-extended Disallow: / User-agent: deepseekbot Disallow: / User-agent: diffbot Disallow: / User-agent: facebookbot Disallow: / User-agent: meta-externalagent Disallow: / User-agent: gptbot Disallow: / User-agent: omgili Disallow: / User-agent: omgilibot Disallow: / User-agent: cohere-training-data-crawler Disallow: / User-agent: deepseek Disallow: / User-agent: deepseek-crawler Disallow: / User-agent: grokbot Disallow: / User-agent: img2dataset Disallow: / User-agent: laiondownloader Disallow: / User-agent: mistralai-crawler Disallow: / User-agent: pangubot Disallow: / User-agent: * Allow: /*all-items.json$ Disallow: /noindex/ Disallow: /suche/index~suggest.jsp Disallow: /*query= Disallow: /*sophoraSSI=true Disallow: /*at_campaign=hr3_kopf_hoch Disallow: */landtagswahl/kandidatencheck/ Disallow: */voice/index.itns Disallow: */website/ Disallow: */d/ Disallow: /*.woff$ Disallow: /*.woff2$ Disallow: /*.json$ Disallow: /assets_4.3*/ Disallow: /assets_4.2*/ Disallow: /assets_4.1*/ Sitemap: https://www.hessenschau.de/indexsitemap.nc.xml
Changes recorded since June 2026.
No change recorded.