utreraweb.com · Spain · measured 8 Oct 2026
As read on 8 Oct 2026, 493 bytes. 1 rule group name AI crawlers; shown first.
User-agent: GPTbot Disallow: / User-agent: * Crawl-delay: 120 Disallow: /wp-login.php Disallow: /?s= Disallow: /search/ Disallow: /wp-content/plugins/ Disallow: /readme.html Disallow: /refer/ Disallow: /wp-admin/ Allow: /wp-admin/admin-ajax.php User-agent: facebookexternalhit Allow: / User-agent: msnbot Crawl-delay: 120 User-agent: discobot Disallow: / User-agent: dotbot Disallow: / User-agent: Slurp Crawl-delay: 4 User-agent: yacybot Disallow: /
Changes recorded since June 2026.
No change recorded.