Le Tarn Libre

letarnlibre.com · France · L'Imprimerie Coopérative du Sud-Ouest · measured 8 Oct 2026

Google Search

Allowed

Google-Extended

Blocked

OpenAI

Blocked

Anthropic

Blocked

Perplexity

Blocked

robots.txt

As read on 8 Oct 2026, 551 bytes. 1 rule group name AI crawlers; shown first.

User-agent: GPTBot
User-agent: ChatGPT-User
User-agent: OAI-SearchBot
User-agent: CCBot
User-agent: Google-Extended
User-agent: PerplexityBot
User-agent: anthropic-ai
User-agent: Claude-Web
User-agent: ClaudeBot
User-agent: cohere-ai
User-agent: Applebot-Extended
User-agent: PetalBot
Disallow: /
Sitemap: https://www.letarnlibre.com/sitemaps.php

User-agent: *
Disallow: /ajax/
Disallow: /applications/
Disallow: /fonts/
Disallow: /newsletter/
Disallow: /recherche/?*
Disallow: /connexion/?*
Disallow: /abonnement/?*
Disallow: /resultats-examens/*/*

History

Changes recorded since June 2026.

No change recorded.

In context

France

42.3% block at least one AI crawler

Behind Cloudflare