maliweb.net · Mali · measured 8 Oct 2026
As read on 8 Oct 2026, 1,414 bytes. 1 rule group name AI crawlers; shown first.
User-agent: meta-externalagent Allow: / User-agent: * Allow: / Disallow: /cgi-bin/ Disallow: /admin_new/ Disallow: /Fckeditor/ Disallow: /FCKeditor1/ Disallow: /annonces/cgi-bin/ Disallow: /dev/ Disallow: /site/ Disallow: /site2/ Disallow: /site2.maliweb.net/ Disallow: /staging.maliweb.net/ User-agent: bingbot Allow: / User-agent: Googlebot Allow: / User-agent: Twitterbot Allow: / User-agent: facebookexternalhit Allow: / User-agent: AhrefsBot Crawl-delay: 5 User-agent: SemrushBot Crawl-delay: 5 User-agent: MJ12bot Crawl-delay: 10 Sitemap: https://www.maliweb.net/sitemap.xml Sitemap: https://www.maliweb.net/sitemap-1.xml Sitemap: https://www.maliweb.net/sitemap-2.xml Sitemap: https://www.maliweb.net/sitemap-3.xml Sitemap: https://www.maliweb.net/sitemap-4.xml Sitemap: https://www.maliweb.net/sitemap-5.xml Sitemap: https://www.maliweb.net/sitemap-6.xml
Changes recorded since June 2026.
No change recorded.