bbc24news.com · Bangladesh · measured 8 Oct 2026
As read on 8 Oct 2026, 230 bytes. No rule names an AI crawler.
User-agent: AhrefsBot Crawl-Delay: 28800 User-agent: SemrushBot Disallow: / User-agent: nbot Disallow: / User-agent: MJ12bot Disallow: / User-agent: * Disallow: Disallow: /cgi-bin/ Disallow: /admin/ Disallow: /system/
Changes recorded since June 2026.
No change recorded.