CrawlerPulse
CrawlerPulse / Asia / South Korea / donga.com

Donga-ilbo

donga.com · South Korea · The DongA Ilbo · measured 8 Oct 2026

Google Search
Allowed
Google-Extended
Allowed
OpenAI
Allowed
Anthropic
Allowed
Perplexity
Allowed
Meta
Allowed
Common Crawl
Allowed
ByteDance
Allowed
Apple
Allowed
Amazon
Allowed

robots.txt

As read on 8 Oct 2026, 665 bytes. No rule names an AI crawler.

User-agent: *
Allow: /news/Sports/article/
Disallow: /search
Disallow: /news/search
Disallow: /news/View
Disallow: /news/dongaars
Disallow: /NEWS
Disallow: /HUB
Disallow: /VOICE
Disallow: /ISSUE
Disallow: /BIZN
Disallow: /STUDIO
Disallow: /SPORTS
Disallow: /VODA
Disallow: /WEEKLY
Disallow: /WOMAN
Disallow: /SHINDONGA
Sitemap: https://www.donga.com/sitemap/donga-newsmap.xml
Sitemap: https://image.donga.com/sitemap/donga-sitemap.xml
Sitemap: https://www.donga.com/sitemap/foreign-newsmap.xml
Sitemap: https://image.donga.com/sitemap/foreign-sitemap.xml

History

Changes recorded since June 2026.

No change recorded.

In context

South Korea
34.6% block at least one AI crawler
Behind Cloudflare
No