CrawlerPulse
CrawlerPulse / Asia / China / caixin.com

Caixin Media

caixin.com · China · measured 9 Oct 2026

Google Search
Blocked
Google-Extended
Blocked
OpenAI
Blocked
Anthropic
Blocked
Perplexity
Blocked
Meta
Blocked
Common Crawl
Blocked
ByteDance
Blocked
Apple
Blocked
Amazon
Blocked

robots.txt

As read on 9 Oct 2026, 232 bytes. 2 rule groups name AI crawlers; shown first.

User-agent: GPTBot
Disallow: /

User-agent: CCBot
Disallow: /

User-agent: Twitterbot
Disallow: /

User-agent:*
Disallow: /*100923808.html
Disallow: /*?$
Disallow: /?*
Disallow: /*?NOJP
Disallow: /*?*=*

History

Changes recorded since June 2026.

No change recorded.

In context

China
7.0% block at least one AI crawler
Behind Cloudflare
No
Same group