CrawlerPulse
CrawlerPulse / Asia / Vietnam / baolangson.vn

Lang Son

baolangson.vn · Vietnam · measured 8 Oct 2026

Google Search
Allowed
Google-Extended
Blocked
OpenAI
Blocked
Anthropic
Blocked
Perplexity
Blocked
Meta
Blocked
Common Crawl
Blocked
ByteDance
Blocked
Apple
Blocked
Amazon
Blocked

robots.txt

As read on 8 Oct 2026, 721 bytes. No rule names an AI crawler.

User-agent: *
Disallow: /

User-agent: Googlebot
Disallow: /tags/
Disallow: /search/
Disallow: /rss/
Allow: /

User-agent: Googlebot-image
Disallow: /tags/
Disallow: /search/
Disallow: /rss/
Allow: /

User-agent: Twitterbot
Disallow: /tags/
Disallow: /search/
Disallow: /rss/
Allow: /

User-agent: Bingbot
Disallow: /tags/
Disallow: /search/
Disallow: /rss/
Allow: /

User-agent: Slurp
Disallow: /tags/
Disallow: /search/
Disallow: /rss/
Allow: /

User-agent: facebookexternalhit
Disallow:
Sitemap: https://baolangson.vn/public/xml/sitemaps_1_index.xml
Sitemap: https://baolangson.vn/public/xml/sitemaps_2_index.xml
Sitemap: https://baolangson.vn/public/xml/sitemaps_3_index.xml

History

Changes recorded since June 2026.

No change recorded.

In context

Vietnam
9.9% block at least one AI crawler
Behind Cloudflare
Yes