CrawlerPulse
CrawlerPulse / Europe / France / marieclaire.fr

marieclaire.fr

marieclaire.fr · France · measured 8 Oct 2026

Google Search
Allowed
Google-Extended
Allowed
OpenAI
Allowed
Anthropic
Allowed
Perplexity
Allowed
Meta
Allowed
Common Crawl
Allowed
ByteDance
Allowed
Apple
Allowed
Amazon
Allowed

robots.txt

As read on 8 Oct 2026, 621 bytes. No rule names an AI crawler.

User-Agent: *
Disallow: /*?firstId=
Disallow: /ope/
Disallow: /adsite-under/
Disallow: /recherche
Disallow: /archives/*/*/*
Disallow: /direct/
Disallow: /photo/*/*/*
Disallow: /blogs/
Disallow: /idees/blogs/
Disallow: /idees/fiches/objet=
Disallow: /idees/fiches/theme=
Disallow: /idees/fiches/technique=
Disallow: /idees/fiches/magazine=
Disallow: /idees/archives/*
Disallow: /maison/blogs/
Disallow: /cuisine/recettes/*
Disallow: /print/article/*
Disallow: /webview/
Disallow: /codes-promo/codes-promo/visit/*
Disallow: /horo/
Disallow: /toutes-les-actus-video/

User-agent: Netvibes
Disallow: /

History

Changes recorded since June 2026.

No change recorded.

In context

France
42.3% block at least one AI crawler
Behind Cloudflare
No