CrawlerPulse
CrawlerPulse / Europe / France / 1jour1actu.com

1jour1actu

1jour1actu.com · France · Groupe Bayard Presse · measured 8 Oct 2026

Google Search
Allowed
Google-Extended
Partial
OpenAI
Partial
Anthropic
Partial
Perplexity
Partial
Meta
Partial
Common Crawl
Partial
ByteDance
Partial
Apple
Partial
Amazon
Partial

robots.txt

As read on 8 Oct 2026, 1,611 bytes. No rule names an AI crawler.

User-agent: *
Disallow: /cgi-bin
Disallow: /wp-login.php
Disallow: /wp-admin
Disallow: /wp-includes
Disallow: /wp-content/plugins
Disallow: /wp-content/cache
Disallow: /maintenance.html
Disallow: /wp-content/themes
Disallow: /category/*/*
Disallow: */trackback
Disallow: */feed
Disallow: */comments
Disallow: /seanceactu/*/*
Disallow: */rechercheHebdo.php*
Disallow: */dictionnaire/*
Disallow: /?s=*
Disallow: /*redirect_uri=
Disallow: /*?s=
Disallow: /search/
Disallow: /*?output=pdf
Disallow: /*?playAgain=
Disallow: /*redirect_uri=
Disallow: /trackback/
Disallow: /*?replytocom=
Disallow: /se-connecter
Disallow: /s-inscrire
Allow: /wp-content/uploads

User-agent: Googlebot
Disallow: /*.php$
Disallow: /*.inc$
Disallow: /*.gz$
Disallow: /*.swf$
Disallow: /*.wmv$
Disallow: /*.cgi$
Disallow: /wp-content/uploads/*.pdf
Disallow: /*?output=pdf
Disallow: /*?playAgain=*#wpvq
Disallow: /*?playAgain
Disallow: /*?playAgain=
Disallow: /*?playAgain=*
Disallow: /*?s=*
Disallow: /se-connecter
Disallow: /s-inscrire
Disallow: /*redirect_uri=
Disallow: /*.xhtml$
Disallow: /*?s=
Disallow: /search/
Disallow: /*?output=pdf
Disallow: /*?playAgain=
Disallow: /*redirect_uri=
Disallow: /trackback/
Disallow: /*?replytocom=
Disallow: /se-connecter
Disallow: /s-inscrire
Sitemap: https://www.1jour1actu.com/sitemap_index.xml

History

Changes recorded since June 2026.

No change recorded.

In context

France
42.3% block at least one AI crawler
Behind Cloudflare
No
Same group