tf1info.fr · France · Groupe TF1 · measured 8 Oct 2026
As read on 8 Oct 2026, 8,284 bytes. 1 rule group name AI crawlers; shown first.
User-agent: AI2Bot User-agent: AI2Bot-DeepResearchEval User-agent: Ai2Bot-Dolma User-agent: Amazonbot User-agent: AmazonBuyForMe User-agent: anthropic-ai User-agent: Applebot-Extended User-agent: bigsur.ai User-agent: Bytespider User-agent: CCBot User-agent: ChatGLM User-agent: ChatGLM-Spider User-agent: ChatGPT-Operator User-agent: ChatGPT-User User-agent: ClaudeBot User-agent: Claude-User User-agent: Claude-Web User-agent: CloudVertexBot User-agent: cohere-ai User-agent: cohere-training-data-crawler User-agent: Cotoyogi User-agent: DataForSeoBot User-agent: Datenbank Crawler User-agent: Devin User-agent: Diffbot User-agent: DuckAssistBot User-agent: FacebookBot User-Agent: FriendlyCrawler User-agent: gemini-deep-research User-agent: GoogleAgent-Mariner User-agent: Google-Extended User-agent: Google-NotebookLM User-agent: GPTBot User-agent: ICC-Crawler User-agent: ImagesiftBot User-agent: imageSpider User-agent: img2dataset User-agent: Kangaroo Bot User-agent: KlaviyoAIBot User-agent: laion-huggingface-processor User-agent: LCC User-agent: LinerBot User-agent: Manus-User User-agent: meta-externalagent User-agent: meta-externalfetcher User-agent: MistralAI-User User-agent: netEstate User-agent: netEstate Imprint Crawler User-agent: NovaAct User-agent: omgili User-agent: OmigiliBot User-agent: PanguBot User-agent: Perplexity-User User-agent: PhindBot User-agent: Poggio-Citations User-agent: QualifiedBot User-agent: SBIntuitionsBot User-Agent: SemrushBot-SWA User-agent: sider.ai User-agent: Spider User-agent: TavilyBot User-agent: TheKnowledgeAI User-agent: TimpiBot User-agent: TwinAgent User-agent: VelenPublicWebCrawler User-agent: webzio-extended User-agent: YouBot Disallow: / User-agent: * Disallow: *Translate* Disallow: */recherche/* Disallow: */coming-next/* Disallow: */particuliers/* Disallow: */examens/resultats/* Disallow: */mdp-reenitialisation/* Disallow: */votre-plus-beau-marche/actualite/* Disallow: /*?v=* Disallow: /*?s=* Disallow: /*?ref=* Disallow: /*?type=* Disallow: /*?page=* Disallow: /*?query=* Disallow: /*?device=* Disallow: /*Echobox=* Disallow: /*?orderby=* Disallow: /*?toDelete=* Disallow: /*?redirect=* Disallow: /*servicetype=* Disallow: /*serviceType=* Disallow: /*?lang=fr&error* User-agent: Twitterbot User-agent: facebookexternalhit Disallow: User-agent: AhrefsBot User-agent: SearchmetricsBot User-agent: rogerbot User-agent: deepcrawl User-Agent: OnCrawl User-agent: Screaming Frog SEO Spider User-agent: MJ12bot User-Agent: Sistrix User-agent: barkrowler Disallow: / Sitemap: https://www.tf1info.fr/sitemap-n.xml Sitemap: https://www.tf1info.fr/sitemap.xml Sitemap: https://www.tf1info.fr/sitemap-pages-0.xml
Changes recorded since June 2026.
No change recorded.