CrawlerPulse
CrawlerPulse / Crawlers

Crawlers

The nine AI crawlers CrawlerPulse tracks, and Google's search crawler for comparison. Share of 12,650 measured news outlets blocking each one.

GPTBotOpenAI
25.2%
CCBotCommon Crawl
24.5%
ClaudeBotAnthropic
22.8%
BytespiderByteDance
22.3%
Google-ExtendedGoogle
20.8%
PerplexityBotPerplexity
19.2%
AmazonbotAmazon
17.6%
GooglebotGoogle
1.4%