CrawlerPulse
CrawlerPulse / Europe / France / letelegramme.fr

Le Télégramme

letelegramme.fr · France · LE TELEGRAMME · measured 8 Oct 2026

Google Search
Partial
Google-Extended
Blocked
OpenAI
Blocked
Anthropic
Blocked
Perplexity
Blocked
Meta
Blocked
Common Crawl
Blocked
ByteDance
Blocked
Apple
Blocked
Amazon
Blocked

robots.txt

As read on 8 Oct 2026, 9,912 bytes. 2 rule groups name AI crawlers; shown first.

User-agent: Google-Extended
User-agent: Applebot-Extended
User-agent: Webzio-Extended
User-agent: GPTBot
User-agent: ClaudeBot
User-agent: MistralAI-Training
User-agent: KimiBot
User-agent: Amazonbot
User-agent: CCBot
User-agent: AI2Bot
Content-Signal: search=no, ai-input=no, ai-train=no
Disallow: /

User-agent: Meta-WebIndexer
User-agent: LinerBot
User-agent: ExaSearchBot
User-agent: YouBot
User-agent: TimpiBot
User-agent: PetalBot
User-agent: Channel3Bot
User-agent: WrtnBot
User-agent: IAskBot
User-agent: Google-CloudVertexBot
User-agent: amazon-kendra
User-agent: Meta-ExternalAgent
User-agent: Brightbot
User-agent: Diffbot
User-agent: FirecrawlAgent
User-agent: ApifyBot
User-agent: ApifyWebsiteContentCrawler
User-agent: Scrapy
User-agent: TavilyBot
User-agent: img2dataset
User-agent: Webzio
User-agent: OAI-SearchBot
User-agent: PerplexityBot
User-agent: Claude-SearchBot
User-agent: MistralAI-Index
User-agent: DuckAssistBot
User-agent: Amzn-SearchBot
User-agent: Kimi-SearchBot
User-agent: ChatGPT-User
User-agent: Claude-User
User-agent: Perplexity-User
User-agent: MistralAI-User
User-agent: Amzn-User
User-agent: Kimi-User
User-agent: Google-GeminiNotebook
User-agent: Google-NotebookLM
User-agent: Meta-ExternalFetcher
User-agent: ExaBot
Content-Signal: search=yes, ai-input=yes, ai-train=no
Allow: /guide-conso/
Disallow: /
Disallow: /guide-conso/*?

Sitemap: https://www.letelegramme.fr/sitemaps/sitemap.xml
Sitemap: https://www.letelegramme.fr/sitemaps/sitemap-news.xml

User-agent: Googlebot
User-agent: Googlebot-Image
User-agent: Googlebot-Video
User-agent: Bingbot
User-agent: Slurp
User-agent: Applebot
User-agent: DuckDuckBot
User-agent: Qwantbot
User-agent: AdsBot-Google
User-agent: AdsBot-Google-Mobile
User-agent: Mediapartners-Google
User-agent: Taboolabot
User-agent: flipboard
User-agent: upday
User-agent: Csnibot
User-agent: bnf.fr_bot
User-agent: Twitterbot
User-agent: facebookexternalhit
User-agent: LinkedInBot
User-agent: WhatsApp
User-agent: Discordbot
User-agent: Slackbot-LinkExpanding
User-agent: TelegramBot
User-agent: Pinterestbot
User-agent: redditbot
User-agent: Mastodon
User-agent: Bluesky
Content-Signal: search=yes, ai-input=no, ai-train=no
Allow: /
Disallow: /_amp/
Disallow: /agenda/rss.xml
Disallow: /agenda/atom.xml
Disallow: /agenda/*/rss.xml
Disallow: /agenda/*/atom.xml
Disallow: /api/
Disallow: /article/
Disallow: /ar/
Disallow: /espace-debat/
Disallow: /ig/
Disallow: /local/
Disallow: /newsletters/
Disallow: /preview/
Disallow: /recherche/
Disallow: /static/pdf/
Disallow: /static/html/

User-agent: Googlebot-News
Content-Signal: search=yes, ai-input=no, ai-train=no
Allow: /
Disallow: /_amp/
Disallow: /api/
Disallow: /article/
Disallow: /ar/
Disallow: /espace-debat/
Disallow: /ig/
Disallow: /local/
Disallow: /newsletters/
Disallow: /preview/
Disallow: /recherche/
Disallow: /static/pdf/
Disallow: /static/html/
Disallow: /infos-pratiques/
Disallow: /annonces/
Disallow: /agenda/
Disallow: /services/
Disallow: /jeux/

User-agent: Google-InspectionTool
Content-Signal: search=yes, ai-input=no, ai-train=no
Allow: /
Disallow: /_amp/
Disallow: /agenda/rss.xml
Disallow: /agenda/atom.xml
Disallow: /agenda/*/rss.xml
Disallow: /agenda/*/atom.xml
Disallow: /api/
Disallow: /article/
Disallow: /ar/
Disallow: /espace-debat/
Disallow: /ig/
Disallow: /local/
Disallow: /newsletters/
Disallow: /recherche/
Disallow: /static/pdf/
Disallow: /static/html/

User-agent: *
Content-Signal: search=no, ai-input=no, ai-train=no
Disallow: /

History

Changes recorded since June 2026.

No change recorded.

In context

France
42.3% block at least one AI crawler
Behind Cloudflare
Yes