CrawlerPulse
CrawlerPulse / Europe / Belgium / nordeclair.fr

Nord Eclair FR

nordeclair.fr · Belgium · Groupe Rossel BE · measured 8 Oct 2026

Google Search
Allowed
Google-Extended
Blocked
OpenAI
Blocked
Anthropic
Blocked
Perplexity
Blocked
Meta
Blocked
Common Crawl
Blocked
ByteDance
Blocked
Apple
Blocked
Amazon
Blocked

robots.txt

As read on 8 Oct 2026, 6,485 bytes. 1 rule group name AI crawlers; shown first.

User-agent: AI2Bot
User-agent: Amazonbot
User-agent: anthropic-ai
User-agent: Applebot-Extended
User-agent: Bytespider
User-agent: CCBot
User-agent: ChatGPT-User
User-agent: ClaudeBot
User-agent: Claude-SearchBot
User-agent: Claude-User
User-agent: Claude-Web
User-agent: cohere-ai
User-agent: Diffbot
User-agent: DuckAssistBot
User-agent: FacebookBot
User-agent: Google-Extended
User-agent: GPTBot
User-agent: Meta-ExternalAgent
User-agent: Meta-ExternalFetcher
User-agent: OAI-SearchBot
User-agent: Perplexity-User
User-agent: PerplexityBot
Allow: /instant/
Allow: /partenaires/
Allow: /immobilier/
Allow: /emploi/
Allow: /shopping/
Allow: /obseques/
Allow: /legales/
Allow: /lvm/
Allow: /sante/
Allow: /le-mag/partenaires/
Allow: /mieux-nous-connaitre/
Disallow: /

User-agent: Mediapartners-Google
User-agent: Googlebot
User-agent: Googlebot-Image
User-agent: Googlebot-Mobile
User-agent: Googlebot-News
User-agent: Googlebot-Video
User-agent: Adsbot-Google
User-agent: Twitterbot
User-agent: Applebot
User-agent: Bingbot
User-agent: exabot
User-agent: Slurp
User-agent: grapeshot
User-agent: ias_crawler
User-agent: Publication-Access-for-Facebook
User-agent: proximic
User-agent: facebookexternalhit
User-agent: Flipboard
User-agent: FlipboardProxy
User-agent: weborama-fetcher
User-agent: Taboolabot
User-agent: upday
User-agent: AmazonAdBot
User-agent: AhrefsBot
User-agent: AhrefsSiteAudit
Crawl-delay: 5
Allow: /
Sitemap: https://www.lavoixdunord.fr/sites/default/files/sitemaps/www_lavoixdunord_fr/sitemapnews-0.xml
Sitemap: https://www.lavoixdunord.fr/sites/default/files/sitemaps/www_lavoixdunord_fr/sitemapindex.xml
Disallow: /scripts/
Disallow: /themes/
Disallow: /simplesaml
Disallow: /simplsamlphp_auth/
Disallow: /wallyextra/contenttypesajax
Disallow: /esi/
Disallow: /includes/
Disallow: /profiles/
Disallow: /misc/
Disallow: /modules/
Disallow: /journal/VDN/
Disallow: /admin/
Disallow: /cgi-bin/
Disallow: /bears/
Disallow: /sites/all/modules/custom/vdn/vdnfreemium/scripts/
Disallow: /CHANGELOG.txt
Disallow: /cron.php
Disallow: /INSTALL.mysql.txt
Disallow: /INSTALL.pgsql.txt
Disallow: /install.php
Disallow: /INSTALL.txt
Disallow: /LICENSE.txt
Disallow: /MAINTAINERS.txt
Disallow: /update.php
Disallow: /UPGRADE.txt
Disallow: /xmlrpc.php
Disallow: /logout
Disallow: /search/
Disallow: /user/register
Disallow: /user/password
Disallow: /user/login
Disallow: /feed/19?format=choixredac
Disallow: /region/weo
Disallow: /economie/journal-eco
Disallow: /region/test-publi
Disallow: /archives/recherche
Disallow: /archive/video
Disallow: /resultats-examens/
Disallow: /agenda-evenements/
Disallow: /*/comment/reply/
Disallow: /archives*
Disallow: /taxonomy/
Disallow: /section/
Disallow: /espace/
Disallow: /espace-debat/utilisateur/
Disallow: /*?from_direct=true$
Disallow: /node/*
Disallow: /Locales*
Disallow: /alternant/
Disallow: /advertising_script.js
Disallow: /lavdn*
Disallow: */www.ultimedia.com/js/common/smart.js
Disallow: */video/MMV
Disallow: /ht-
Disallow: /*,*
Disallow: /*?amp
Disallow: /*?referer=/archives/
Disallow: /*?offset=
Disallow: /*/*/*/types$
Disallow: /*/*/*/modules
Disallow: /*/*/*/pixelDisplay$
Disallow: /*/*/*/productDisplay$
Disallow: /*/*/*/util$
Disallow: /*/*/*/sets$
Disallow: /*/*/*/lavdn.lavoixdunord.fr
Disallow: /*/*/*/positions$
Allow: /.well-known/
Allow: /apple-app-site-association
Allow: /misc/*.js
Allow: /misc/*.css
Allow: /modules/*.js
Allow: /modules/*.css
Allow: /profiles/*.js
Allow: /profiles/*.css
Allow: /themes/*.js
Allow: /themes/*.css
Allow: */modules/*.js

User-agent: exabot
User-agent: Slurp
Crawl-Delay: 20

User-agent: 5emeRue
User-agent: 5erue
User-agent: adequat
User-agent: adequat-systems
User-agent: AmiSoftware
User-agent: AwarioRssBot
User-agent: AwarioSmartBot
User-agent: Argus
User-agent: Ask n read
User-agent: asknread.com
User-agent: Augure
User-agent: auramundi
User-agent: Bloodhound
User-agent: Cision
User-agent: coexel
User-agent: ConveraCrawler
User-agent: Corporama
User-agent: cydralspider
User-agent: Digimind
User-agent: Download Ninja
User-agent: downloadexpress
User-agent: EDD
User-agent: ellisphere
User-agent: eureka
User-agent: Europresse
User-agent: Explore
User-agent: Factiva
User-agent: Fasterfox
User-agent: Fetch
User-agent: gammaSpider
User-agent: grub-client
User-agent: HTTrack
User-agent: ia_archiver
User-agent: ia_archiver-web.archive.org
User-agent: indexer
User-agent: infoseek
User-agent: Jetbot
User-agent: k2spider
User-agent: Kantar
User-agent: kbcrawl
User-agent: Knowings
User-agent: larbin
User-agent: leadbox
User-agent: libwww
User-agent: linkfluence
User-agent: linko
User-agent: manageo
User-agent: mediacompil
User-agent: Meltwater
User-agent: mention
User-agent: Moreover
User-agent: MSIECrawler
User-agent: mytwip
User-agent: newscan-online
User-agent: NewsNow
User-agent: Newzbin
User-agent: NPBot
User-agent: ObjectsSearch
User-agent: Offline Explorer
User-agent: opinion-tracker
User-agent: Pimptrain
User-agent: proxem
User-agent: QuepasaCreep
User-agent: Qwam content intelligence
User-agent: Raven
User-agent: readability.com
User-agent: scoop.it
User-agent: score3
User-agent: Sindup
User-agent: sitecheck.internetseer.com
User-agent: SiteSnagger
User-agent: spotter
User-agent: Synthesio
User-agent: Talkwater
User-agent: Teleport
User-agent: TeleportPro
User-agent: trendeo
User-agent: trendybuzz
User-agent: TunitinBot
User-agent: TurnitinBot
User-agent: up2news
User-agent: vecteurplus
User-agent: Verif
User-agent: verticalsearch
User-agent: vsw
User-agent: wapspider
User-agent: WebCopier
User-agent: WebReaper
User-agent: WebStripper
User-agent: WebZinger
User-agent: WebZIP
User-agent: Wget
User-agent: winello
User-agent: Youmag
User-agent: Zealbot
User-agent: Zite
User-agent: ZyBORG
Disallow: /

History

Changes recorded since June 2026.

No change recorded.

In context

Belgium
37.5% block at least one AI crawler
Behind Cloudflare
No
Same group
grenzecho.net, lacapitale.be, lameuse.be, lanouvellegazette.be, laprovince.be, lesoir.be, fr.metrotime.be, nordeclair.sudinfo.be, sudinfo.be, zita.be