CrawlerPulse
CrawlerPulse / Africa / Zimbabwe / zimtelegraph.com

zimtelegraph.com

zimtelegraph.com · Zimbabwe · measured 8 Oct 2026

Google Search
Allowed
Google-Extended
Allowed
OpenAI
Allowed
Anthropic
Allowed
Perplexity
Allowed
Meta
Allowed
Common Crawl
Allowed
ByteDance
Allowed
Apple
Allowed
Amazon
Allowed

robots.txt

As read on 8 Oct 2026, 2,958 bytes. No rule names an AI crawler.

User-agent: Digincore
Disallow: /

User-agent: Grabber
Disallow: /

User-agent: Cosmos
Disallow: /

User-agent: trendiction.de
Disallow: /

User-agent: evc-batch
Disallow: /

User-agent: Titan
Disallow: /

User-agent: Libwhisker
Disallow: /

User-agent: WebGo IS
Disallow: /

User-agent: Brandprotect
Disallow: /

User-agent: WebCollage
Disallow: /

User-agent: Jorgee
Disallow: /

User-agent: IlseBot
Disallow: /

User-agent: Offline Explorer
Disallow: /

User-agent: Rankivabot
Disallow: /

User-agent: TightTwatBot
Disallow: /

User-agent: DittoSpyder
Disallow: /

User-agent: Alexibot
Disallow: /

User-agent: AhrefsBot
Disallow: /

User-agent: SemrushBot-SA
Disallow: /

User-agent: MJ12bot
Disallow: /

User-agent: SurveyBot
Disallow: /

User-agent: ia_archiver
Disallow: /

User-agent: SemrushBot
Disallow: /

User-agent: rogerbot
Disallow: /

User-agent: dotbot
Disallow: /

User-agent: WebStripper
Disallow: /

User-agent: mediawords
Disallow: /

User-agent: Steeler
Disallow: /

User-agent: Jetty
Disallow: /

User-agent: Needle
Disallow: /

User-agent: crawl.sogou.com
Disallow: /

User-agent: WebsiteQuester
Disallow: /

User-agent: Niki-bot
Disallow: /

User-agent: Pimonster
Disallow: /

User-agent: TeleportPro
Disallow: /

User-agent: Lftp
Disallow: /

User-agent: InfoTekies
Disallow: /

User-agent: BuiltWith
Disallow: /

User-agent: Zitebot
Disallow: /

User-agent: The Intraformant
Disallow: /

User-agent: JOC Web Spider
Disallow: /

User-agent: BatchFTP
Disallow: /

User-agent: Ezooms
Disallow: /

User-agent: BetaBot
Disallow: /

User-agent: MauiBot
Disallow: /

User-agent: WebZIP
Disallow: /

User-agent: Nmap
Disallow: /

User-agent: TwengaBot
Disallow: /

User-agent: T8Abot
Disallow: /

User-agent: SlySearch
Disallow: /

User-agent: ZumBot
Disallow: /

User-agent: RSSingBot
Disallow: /

User-agent: FemtosearchBot
Disallow: /

User-agent: coccocbot-web
Disallow: /

User-agent: Drip
Disallow: /

User-agent: Snoopy
Disallow: /

User-agent: Voil
Disallow: /

User-agent: RebelMouse
Disallow: /

User-agent: SputnikBot
Disallow: /

User-agent: crawler4j
Disallow: /

User-agent: Backlink-Ceck
Disallow: /

User-agent: demandbase-bot
Disallow: /

User-agent: Lipperhey Spider
Disallow: /

User-agent: WWW::Mechanize
Disallow: /

User-agent: com.plumanalytics
Disallow: /

User-agent: internetVista monitor
Disallow: /

User-agent: Xenu
Disallow: /

User-agent: PictureFinder
Disallow: /

User-agent: Thumbor
Disallow: /

User-agent: HEADMasterSEO
Disallow: /

User-agent: lwp-trivial
Disallow: /

User-agent: scan.lol
Disallow: /

User-agent: NetZIP
Disallow: /

User-agent: Vacuum
Disallow: /

User-agent: Tracemyfile
Disallow: /

User-agent: Mail.RU_Bot
Disallow: /

User-agent: WBSearchBot
Disallow: /

User-agent: Picscout
Disallow: /

User-agent: Name Intelligence
Disallow: /

User-agent: Exabot
Disallow: /

User-agent: EirGrabber
Disallow: /

History

Changes recorded since June 2026.

No change recorded.

In context

Zimbabwe
11.6% block at least one AI crawler
Behind Cloudflare
No