rci.fm · Guadeloupe · measured 8 Oct 2026
As read on 8 Oct 2026, 6,761 bytes. 12 rule groups name AI crawlers; shown first.
User-agent: GPTBot Crawl-delay: 30 Disallow: /*?pg= Disallow: /*?page= Disallow: /*&pg= Disallow: /*&page= Disallow: /ajax/ Disallow: /data/ User-agent: ClaudeBot Crawl-delay: 30 Disallow: /*?pg= Disallow: /*?page= Disallow: /*&pg= Disallow: /*&page= Disallow: /ajax/ Disallow: /data/ User-agent: PerplexityBot Crawl-delay: 30 Disallow: /*?pg= Disallow: /*?page= Disallow: /ajax/ Disallow: /data/ User-agent: CCBot Crawl-delay: 30 Disallow: /*?pg= Disallow: /*?page= User-agent: Bytespider Disallow: / User-agent: bytespider Disallow: / User-agent: Meta-ExternalAgent Crawl-delay: 30 Disallow: /*?pg= Disallow: /*?page= Disallow: /*&pg= Disallow: /*&page= Disallow: /ajax/ Disallow: /data/ User-agent: meta-externalagent Crawl-delay: 30 Disallow: /*?pg= Disallow: /*?page= Disallow: /*&pg= Disallow: /*&page= Disallow: /ajax/ Disallow: /data/ User-agent: Google-Extended Crawl-delay: 30 Disallow: /*?pg= Disallow: /*?page= Disallow: /*&pg= Disallow: /*&page= Disallow: /ajax/ Disallow: /data/ User-agent: Applebot-Extended Crawl-delay: 30 Disallow: /*?pg= Disallow: /*?page= Disallow: /*&pg= Disallow: /*&page= Disallow: /ajax/ Disallow: /data/ User-agent: anthropic-ai Crawl-delay: 30 Disallow: /*?pg= Disallow: /*?page= Disallow: /ajax/ Disallow: /data/ User-agent: MistralAI-User Crawl-delay: 30 Disallow: /*?pg= Disallow: /*?page= Disallow: /ajax/ Disallow: /data/ User-agent: * Allow: /core/*.css$ Allow: /core/*.css? Allow: /core/*.js$ Allow: /core/*.js? Allow: /core/*.gif Allow: /core/*.jpg Allow: /core/*.jpeg Allow: /core/*.png Allow: /core/*.svg Allow: /profiles/*.css$ Allow: /profiles/*.css? Allow: /profiles/*.js$ Allow: /profiles/*.js? Allow: /profiles/*.gif Allow: /profiles/*.jpg Allow: /profiles/*.jpeg Allow: /profiles/*.png Allow: /profiles/*.svg Disallow: */comment/reply Disallow: /core/ Disallow: /profiles/ Disallow: /README.txt Disallow: /web.config Disallow: /*/admin/ Disallow: */comment/reply Disallow: /filter/tips Disallow: /*/node/add/ Disallow: /*/search/ Disallow: /*/user/register/ Disallow: /*/user/password/ Disallow: /*/user/login/ Disallow: /*/user/logout/ Disallow: /*/index.php/admin/ Disallow: /*/index.php/comment/reply/ Disallow: /*/index.php/filter/tips Disallow: /*/index.php/node/add/ Disallow: /*/index.php/search/ Disallow: /*/index.php/user/password/ Disallow: /*/index.php/user/register/ Disallow: /*/index.php/user/login/ Disallow: /*/index.php/user/logout/ Disallow: /*/cgv Disallow: /*/node/ Disallow: /node/ Disallow: /*/taxonomy/ Disallow: /taxonomy/ Disallow: /*/comment/ Disallow: /*/app/ Disallow: /*/fb/ Disallow: /*/infos/avis-guadeloupe_rss Disallow: /*/replays/export User-agent: SemrushBot Disallow: / User-agent: AhrefsBot Disallow: / User-agent: MJ12bot Disallow: / User-agent: meta-webindexer Disallow: / User-agent: Meta-webindexer Disallow: / User-agent: Googlebot-Image Crawl-delay: 30 Disallow: /sites/default/files/styles/thumbnail/ Disallow: /sites/default/files/styles/100x100/ Disallow: /sites/default/files/styles/729x40/ Disallow: /sites/default/files/styles/avatar/ Disallow: /sites/default/files/styles/linkit_result_thumbnail/ Disallow: /sites/default/files/styles/media_entity_browser_thumbnail/ Disallow: /sites/default/files/styles/media_library/ Disallow: /sites/default/files/styles/mailchimp_290x168/ Disallow: /sites/default/files/styles/mailchimp_290x229/ Disallow: /sites/default/files/styles/mailchimp_330x305/ Disallow: /sites/default/files/styles/mailchimp_600x267/
Changes recorded since June 2026.
No change recorded.