wwd.com · United States · Penske Media Corporation · measured 8 Oct 2026
As read on 8 Oct 2026, 1,675 bytes. 20 rule groups name AI crawlers; shown first.
User-agent: anthropic-ai Allow: /shop/ Disallow: / User-agent: cohere-ai Allow: /shop/ Disallow: / User-agent: omgili Allow: /shop/ Disallow: / User-agent: omgilibot Allow: /shop/ Disallow: / User-agent: Applebot-Extended Allow: /shop/ Disallow: / User-agent: Bytespider Allow: /shop/ Disallow: / User-agent: CCBot Allow: /shop/ Disallow: / User-agent: ChatGPT-User Allow: /shop/ Disallow: / User-agent: DeepSeekBot Allow: /shop/ Disallow: / User-agent: GPTBot Allow: /shop/ Disallow: / User-agent: OAI-SearchBot Allow: /shop/ Disallow: / User-agent: ClaudeBot Allow: /shop/ Disallow: / User-agent: Claude-Web Allow: /shop/ Disallow: / User-agent: Diffbot Allow: /shop/ Disallow: / User-agent: FacebookBot Allow: /shop/ Disallow: / User-agent: Google-Extended Allow: /shop/ Disallow: / User-agent: Meta-ExternalAgent Allow: /shop/ Disallow: / User-agent: PerplexityBot Allow: /shop/ Disallow: / User-agent: Timpibot Allow: /shop/ Disallow: / User-agent: YouBot Allow: /shop/ Disallow: / User-agent: * Disallow: /account/ Disallow: /wp-json/wwd/v1/login/ Sitemap: https://wwd.com/sitemap_index.xml Sitemap: https://wwd.com/news-sitemap.xml User-agent: * Disallow: /wp-admin/ Allow: /wp-admin/admin-ajax.php Disallow: /?s= Disallow: /*/?s= Disallow: /search/ Disallow: /search? Disallow: *?v02 Disallow: *?replytocom Disallow: /*preview=true Disallow: /*theme_preview=true User-agent: ChatGPT Allow: /shop/ Disallow: / User-agent: DeepSeek Allow: /shop/ Disallow: / User-agent: Meta-ExternalFetcher Allow: /shop/ Disallow: / User-agent: Webzio-Extended Allow: /shop/ Disallow: / User-agent: cXensebot Crawl-delay: 5 User-agent: Tollbot/1.0 Allow: /
Changes recorded since June 2026.
No change recorded.