thenextweb.com · Netherlands · measured 9 Oct 2026
As read on 9 Oct 2026, 301 bytes. No rule names an AI crawler.
User-agent: * Disallow: /admin/* Disallow: /cpresources/ Disallow: /vendor/ Disallow: /.env Disallow: /docs/3.x/fr/ Disallow: /index.php/actions/ Disallow: /cdn-cgi/ Disallow: /*/page/*/json User-agent: googlebot-news Disallow: /shareables/ Sitemap: https://sitemaps.thenextweb.com/sitemap_index.xml
Changes recorded since June 2026.
No change recorded.