CrawlerPulse
CrawlerPulse / Europe / France / rtl.fr

rtl

rtl.fr · France · Groupe M6 · measured 8 Oct 2026

Google Search
Allowed
Google-Extended
Blocked
OpenAI
Blocked
Anthropic
Allowed
Perplexity
Allowed
Meta
Allowed
Common Crawl
Blocked
ByteDance
Allowed
Apple
Allowed
Amazon
Allowed

robots.txt

As read on 8 Oct 2026, 962 bytes. 4 rule groups name AI crawlers; shown first.

User-agent: ChatGPT-User
Disallow: /

User-agent: GPTBot
Disallow: /

User-agent: CCBot
Disallow: /

User-agent: Google-Extended
Disallow: /

User-agent: *
Disallow: /_header_nav_ajax.html
Disallow: /emission/laurent-gerra/ecouter/*2010
Disallow: /emission/laurent-gerra/ecouter/*2011
Disallow: /emission/laurent-gerra/ecouter/*janvier-2012
Disallow: /3338/
Disallow: /recherche*
Disallow: /archive/
Disallow: /vote/
Disallow: /partager/
Disallow: /ajax/
Disallow: /outils/
Disallow: /recherche*
Disallow: /connect/
Disallow: /resultats-examens/
Disallow: /widgets*
Disallow: /emploi*
Disallow: /code-promo*
Disallow: */amp
Disallow: /elections-regionales/
Disallow: /elections-departementales/
Disallow: /election-presidentielle/
Disallow: /presidentielle-2022/
Disallow: /legislatives-2022/
Disallow: /elections/*/circonscription-
Sitemap: https://www.rtl.fr/sitemap-news.xml
Sitemap: https://www.rtl.fr/sitemap.xml

History

Changes recorded since June 2026.

No change recorded.

In context

France
42.3% block at least one AI crawler
Behind Cloudflare
No