stern.de · Germany · Gruner + Jahr GmbH · measured 8 Oct 2026
As read on 8 Oct 2026, 1,055 bytes. 6 rule groups name AI crawlers; shown first.
User-agent: Diffbot Disallow: / User-agent: GPTBot Disallow: / Allow: /kaufkosmos/ Allow: /ada/ User-agent: ChatGPT-User Disallow: / Allow: /kaufkosmos/ Allow: /ada/ User-agent: Applebot-Extended Disallow: / Allow: /kaufkosmos/ Allow: /ada/ User-agent: CCBot Disallow: / User-agent: Google-Extended Disallow: / Allow: /kaufkosmos/ Allow: /ada/ User-agent: msnbot-media/1.1 Disallow: / User-agent: msnbot-media/2.0b Disallow: / User-agent: Googlebot-News Disallow: /noch-fragen/ Disallow: /action/ Disallow: /sn/ Disallow: /syndication/ Disallow: /elastic/ Disallow: /gutscheine/ Disallow: /search? Disallow: /vergleich/ Disallow: /p-api/* Disallow: /siegel/aerzte/ Disallow: /p-user/ User-agent: scrapy Disallow: / User-agent: RyteBot Disallow: / User-agent: proximic Disallow: /*&share=* User-agent: * Disallow: /action/ Disallow: /sn/ Disallow: /syndication/ Disallow: /elastic/ Disallow: /gutscheine/wp-admin/ Disallow: /search? Disallow: /vergleich/zum/ Disallow: /siegel/aerzte/ Disallow: /p-api/ Disallow: /p-user/ Disallow: /suche/
Changes recorded since June 2026.
No change recorded.