CrawlerPulse
CrawlerPulse / Europe / France / largus.fr

argus

largus.fr · France · Sneep.SAS · measured 8 Oct 2026

Google Search
Allowed
Google-Extended
Blocked
OpenAI
Blocked
Anthropic
Blocked
Perplexity
Allowed
Meta
Allowed
Common Crawl
Blocked
ByteDance
Allowed
Apple
Allowed
Amazon
Blocked

robots.txt

As read on 8 Oct 2026, 5,251 bytes. 7 rule groups name AI crawlers; shown first.

User-agent: Amazonbot
Disallow: /

User-agent: anthropic-ai
Disallow: /

User-agent: CCBot
Disallow: /

User-agent: ClaudeBot
Disallow: /

User-agent: GPTBot
Disallow: /

User-agent: Google-Extended
Disallow: /

User-agent: Diffbot
Allow: /

User-agent: *
Allow: /core/*.css$
Allow: /core/*.css?
Allow: /core/*.js$
Allow: /core/*.js?
Allow: /core/*.gif
Allow: /core/*.jpg
Allow: /core/*.jpeg
Allow: /core/*.png
Allow: /core/*.svg
Allow: /profiles/*.css$
Allow: /profiles/*.css?
Allow: /profiles/*.js$
Allow: /profiles/*.js?
Allow: /profiles/*.gif
Allow: /profiles/*.jpg
Allow: /profiles/*.jpeg
Allow: /profiles/*.png
Allow: /profiles/*.svg
Disallow: /core/
Disallow: /profiles/
Disallow: /README.md
Disallow: /composer/Metapackage/README.txt
Disallow: /composer/Plugin/ProjectMessage/README.md
Disallow: /composer/Plugin/Scaffold/README.md
Disallow: /composer/Plugin/VendorHardening/README.txt
Disallow: /composer/Template/README.txt
Disallow: /modules/README.txt
Disallow: /sites/README.txt
Disallow: /themes/README.txt
Disallow: /web.config
Disallow: /admin/
Disallow: /comment/reply/
Disallow: /filter/tips
Disallow: /node/add/
Disallow: /search/
Disallow: /user/register
Disallow: /user/password
Disallow: /user/login
Disallow: /user/logout
Disallow: /media/oembed
Disallow: /*/media/oembed
Disallow: /index.php/admin/
Disallow: /index.php/comment/reply/
Disallow: /index.php/filter/tips
Disallow: /index.php/node/add/
Disallow: /index.php/search/
Disallow: /index.php/user/password
Disallow: /index.php/user/register
Disallow: /index.php/user/login
Disallow: /index.php/user/logout
Disallow: /index.php/media/oembed
Disallow: /index.php/*/media/oembed
Allow: /img/logos/
Disallow: /actualite-automobile/emplois/
Disallow: /actualite-automobile/vo_vn.html
Disallow: /aol/
Disallow: /monargus/
Disallow: /popup.cfm
Disallow: /occasion/une/
Disallow: /go.cfm
Disallow: /emploi/
Disallow: /enchere-domaine-appel-offre/
Disallow: /vehicule-industriel/
Disallow: /js/
Disallow: /script/
Disallow: /include/
Disallow: /css/
Disallow: /img/
Disallow: /cote/fre/
Disallow: /occasion/annonces.cfm
Disallow: /neuf/annonces.cfm
Disallow: /occasion/fiche_technique/fiches.cfm
Disallow: /vignettes/svc.cfm
Disallow: /minisites/main.cfm
Disallow: /v4/proxy/
Disallow: /v4/remote/
Disallow: /pro/proxy/
Disallow: /trophee/
Disallow: /analytics/
Disallow: /v4/ColdboxProxy.cfc
Disallow: /inauguration/argus/
Disallow: /*/envoi-ami.html
Disallow: /fusionreactor/
Disallow: /v4/index.cfm?event=groupe.WebCallBack*
Disallow: https://www.largus.fr/images/newsletter/
Disallow: /paiement/
Disallow: *?marque=*&modele=*
Disallow: /images/newsletter*
disallow: */archive/?query=*
Disallow: /forum-auto/profile.php?id=*
Disallow: /forum-auto/post.php
Disallow: /forum-auto/search.php
Disallow: /forum-auto/ajout-avis/
Disallow: /forum-auto/profile.php
Disallow: /forum-auto/*?id
Disallow: /forum-auto/*?pid
Disallow: /forum-auto/*?type_panne
Disallow: /forum-auto/*.gif
Allow: /forum-auto/*js/
Allow: /forum-auto/*css/
Allow: /forum-auto/*img/
Disallow: /forum-auto/*img/*.gif
Disallow: /forum-auto/search.php?action=*
Disallow: /?id_tag_principal=*&action=*&critere_recherche=*
disallow: /monArgus/login/mot-de-passe-oublie/
Disallow: /V5/Argus/Part/remote/Partenaires.cfc?method=getFooter&partenaire=autoevasion&univers=communaute
Disallow: /v4/index.cfm?event=particulier.service.FraisReparation
Disallow: /v4/?event=particulier.Common.dspHeader&univers=
Disallow: /pros/forbidden-access
Disallow: /pros/forbidden-access/
Disallow: /pros/not-subscriber/
Disallow: /pros/not-subscriber/login*
Disallow: /V5/Argus/Part/remote/
Disallow: /v4/?event=groupe.LeadCote
Disallow: /core/modules/statistics/
Disallow: /largus/esi/
Disallow: /images/images/*?

User-agent: Baiduspider
Disallow: /

User-agent: Baiduspider-video
Disallow: /

User-agent: Baiduspider-image
Disallow: /

User-agent: moget
User-agent: ichiro
Disallow: /

User-agent: NaverBot
User-agent: Yeti
Disallow: /

User-agent: sogou spider
Disallow: /

User-agent: YoudaoBot
Disallow: /
Sitemap: https://www.largus.fr/sitemap-news.xml
Sitemap: https://www.largus.fr/sitemap.xml
Sitemap: https://www.largus.fr/sitemap-guide-d-achat-occasion.xml

User-agent: 008
Disallow: /

User-agent: sitebot
Disallow: /

User-agent: SemjiBot
Allow: /
Disallow: /index.php/user/password
Disallow: /index.php/user/register
Disallow: /index.php/user/login
Disallow: /index.php/user/logout
Disallow: /index.php/media/oembed
Disallow: /index.php/*/media/oembed

History

Changes recorded since June 2026.

No change recorded.

In context

France
42.3% block at least one AI crawler
Behind Cloudflare
No