CrawlerPulse
CrawlerPulse / Africa / Côte d'Ivoire / lebanco.net

lebanco.net

lebanco.net · Côte d'Ivoire · measured 8 Oct 2026

Google Search
Allowed
Google-Extended
Allowed
OpenAI
Allowed
Anthropic
Allowed
Perplexity
Allowed
Meta
Allowed
Common Crawl
Allowed
ByteDance
Allowed
Apple
Allowed
Amazon
Allowed

robots.txt

As read on 8 Oct 2026, 1,513 bytes. No rule names an AI crawler.

User-agent: *
Allow: /
Sitemap: https://lebanco.net/sitemap_index.xml
Sitemap: https://lebanco.net/sitemap.php
Sitemap: https://lebanco.net/sitemap_news.php
Sitemap: https://lebanco.net/sitemap_images.php
Disallow: /config/
Disallow: /cgi-bin/
Disallow: /dev/
Disallow: /vendor/
Disallow: /cache/
Disallow: /test.php
Disallow: /test.html
Disallow: /testing.html
Disallow: /zz.php
Disallow: /zz.html
Disallow: /a.php
Disallow: /testSearch.php
Disallow: /testSearchResult.php
Disallow: /test-rss.php
Disallow: /index2.php
Disallow: /index_back.php
Disallow: /index-demo-ads.php
Disallow: /index-06-06-2020.php
Disallow: /index-18-06-2020.php
Disallow: /index-copie-31082025.php
Disallow: /index-backup-pre-refactor.php
Disallow: /error_log
Disallow: /php.ini
Disallow: /composer.json
Disallow: /index.html
Disallow: /index.html.1
Disallow: /index.html.2
Disallow: /news.html

User-agent: AhrefsBot
Crawl-delay: 10

User-agent: SemrushBot
Crawl-delay: 10

User-agent: MJ12bot
Crawl-delay: 30

User-agent: DotBot
Crawl-delay: 30

History

Changes recorded since June 2026.

No change recorded.

In context

Côte d'Ivoire
7.7% block at least one AI crawler
Behind Cloudflare
No