CrawlerPulse
CrawlerPulse / Europe / France / journaldunet.com

Journal du net

journaldunet.com · France · CCM Benchmark · measured 8 Oct 2026

Google Search
Allowed
Google-Extended
Allowed
OpenAI
Allowed
Anthropic
Allowed
Perplexity
Allowed
Meta
Allowed
Common Crawl
Allowed
ByteDance
Allowed
Apple
Allowed
Amazon
Allowed

robots.txt

As read on 8 Oct 2026, 1,579 bytes. No rule names an AI crawler.

User-agent: antibot
Disallow: /temoignage
Disallow: /jeu
Disallow: /recherche

User-agent: AmazonAdBot
Allow: /

User-agent: *
Disallow: /s/
Disallow: /profile/
Disallow: /*/s/
Disallow: /*f_impression=1
Disallow: /*?print
Disallow: /*zone=printer
Disallow: /imprimer/
Disallow: /*/imprimer/
Disallow: /*f_imprimer
Disallow: /recherche/
Disallow: /*/recherche/
Disallow: /*/temoignage/reagir/
Disallow: /management/ville/recherche
Disallow: /economie/impots/*,
Disallow: /economie/impots/*/ville-*/*-
Disallow: /economie/impots/*/departement-*/*-
Disallow: /economie/impots/*/region-*/*-
Disallow: /economie/impots/recherche
Disallow: /business/budget-ville/*,
Disallow: /business/budget-ville/*/ville-*/*-
Disallow: /business/budget-ville/*/departement-*/*-
Disallow: /business/budget-ville/*/region-*/*-
Disallow: /business/budget-ville/recherche
Disallow: /business/salaire/recherche
Disallow: /business/salaire/patron/recherche
Disallow: /account/login
Disallow: /*xhr
Disallow: /*/*/comparaison
Disallow: /*/comparaison
Disallow: /*?compare
Disallow: /api/
Disallow: /od/comments/*/create

User-agent: Mediapartners-Google*
Disallow:
Sitemap: https://www.journaldunet.com/sitemap/
Sitemap: https://www.journaldunet.com/sitemap/video-news/

User-agent: dotbot
Disallow: /

User-agent: AhrefsBot
Disallow: /

User-agent: DataForSeoBot
Disallow: /

User-agent: SemrushBot
Disallow: /

History

Changes recorded since June 2026.

No change recorded.

In context

France
42.3% block at least one AI crawler
Behind Cloudflare
No
Same group