CrawlerPulse
CrawlerPulse / Asia / Vietnam / baocaobang.vn

Cao Bang

baocaobang.vn · Vietnam · measured 8 Oct 2026

Google Search
Allowed
Google-Extended
Blocked
OpenAI
Blocked
Anthropic
Blocked
Perplexity
Blocked
Meta
Blocked
Common Crawl
Blocked
ByteDance
Blocked
Apple
Blocked
Amazon
Blocked

robots.txt

As read on 8 Oct 2026, 593 bytes. No rule names an AI crawler.

User-agent: *
Disallow: /

User-agent: Googlebot
Disallow: /tags/
Disallow: /search/
Disallow: /rss/
Allow: /

User-agent: Googlebot-image
Disallow: /tags/
Disallow: /search/
Disallow: /rss/
Allow: /

User-agent: Twitterbot
Disallow: /tags/
Disallow: /search/
Disallow: /rss/
Allow: /

User-agent: Bingbot
Disallow: /tags/
Disallow: /search/
Disallow: /rss/
Allow: /

User-agent: Slurp
Disallow: /tags/
Disallow: /search/
Disallow: /rss/
Allow: /

User-agent: facebookexternalhit
Disallow:
Sitemap: https://baocaobang.vn/public/xml/sitemaps_4_index.xml

History

Changes recorded since June 2026.

No change recorded.

In context

Vietnam
9.9% block at least one AI crawler
Behind Cloudflare
No