faz-bm.de · Germany · Frankfurter Allgemeine Zeitung GmbH · measured 8 Oct 2026
As read on 8 Oct 2026, 1,326 bytes. 6 rule groups name AI crawlers; shown first.
User-agent: omgili Disallow: / User-agent: omgilibot Disallow: / User-agent: CCBot Disallow: / User-agent: Bytespider Disallow: / User-agent: Diffbot Disallow: / User-agent: YouBot Disallow: / User-agent: * Disallow: /wp-login.php Disallow: /wp-admin/ Disallow: /search/ Disallow: /?s=* Allow: /wp-admin/admin-ajax.php User-agent: Meltwater Disallow: / User-agent: NewsNow Disallow: / User-agent: Bloodhound Disallow: / User-agent: cydralspider Disallow: / User-agent: downloadexpress Disallow: / User-agent: gammaSpider Disallow: / User-agent: ObjectsSearch Disallow: / User-agent: Pimptrain Disallow: / User-agent: Raven Disallow: / User-agent: wapspider Disallow: / User-agent: WebZinger Disallow: / User-agent: Fasterfox Disallow: / User-agent: sentibot Disallow: / User-agent: SemrushBot Disallow: /
Changes recorded since June 2026.
No change recorded.