CrawlerPulse
CrawlerPulse / Asia / China / ucanews.com

Union of Catholic Asian News

ucanews.com · China · measured 9 Oct 2026

Google Search
Allowed
Google-Extended
Allowed
OpenAI
Allowed
Anthropic
Allowed
Perplexity
Allowed
Meta
Allowed
Common Crawl
Allowed
ByteDance
Allowed
Apple
Allowed
Amazon
Allowed

robots.txt

As read on 9 Oct 2026, 434 bytes. 1 rule group name AI crawlers; shown first.

User-agent: Google-Extended
Allow: /

User-agent: GoogleAgent-URLContext
Allow: /

User-agent: Gemini-Deep-Research
Allow: /

User-Agent: *
Sitemap: https://www.ucanews.com/sitemap.xml
Sitemap: https://www.ucanews.com/sitemap-directory.xml
Sitemap: https://www.ucanews.com/sitemap-news.xml
Disallow: /cron
Disallow: /search
Disallow: /campaign
Disallow: /captcha
Disallow: /db
Disallow: /*.js$

User-agent: SeekportBot
Crawl-delay: 2

History

Changes recorded since June 2026.

No change recorded.

In context

China
7.0% block at least one AI crawler
Behind Cloudflare
Yes