CrawlerPulse
CrawlerPulse / Asia / China / shobserver.com

Shanghai Observer

shobserver.com · China · measured 9 Oct 2026

Google Search
Allowed
Google-Extended
Allowed
OpenAI
Allowed
Anthropic
Allowed
Perplexity
Allowed
Meta
Allowed
Common Crawl
Allowed
ByteDance
Allowed
Apple
Allowed
Amazon
Allowed

robots.txt

As read on 9 Oct 2026, 225 bytes. No rule names an AI crawler.

<!doctype html><html><frameset rows="100%"><frame src="https://www.shobserver.com/staticsg/home/robots.txt"><noframes><a href="https://www.shobserver.com/staticsg/home/robots.txt">Click here</a></noframes></frameset></html>

History

Changes recorded since June 2026.

No change recorded.

In context

China
7.0% block at least one AI crawler
Behind Cloudflare
No