CrawlerPulse
CrawlerPulse / Asia / South Korea / kgnews.co.kr

kgnews.co.kr

kgnews.co.kr · South Korea · measured 8 Oct 2026

Google Search
Allowed
Google-Extended
Allowed
OpenAI
Allowed
Anthropic
Allowed
Perplexity
Allowed
Meta
Allowed
Common Crawl
Allowed
ByteDance
Allowed
Apple
Allowed
Amazon
Allowed

robots.txt

As read on 8 Oct 2026, 506 bytes. No rule names an AI crawler.

User-agent: *
Disallow: /news/search_result.html
Disallow: /mobile/search_result.html

User-agent: Yeti
Allow:/
Allow: /favicon.ico
Allow: /data/skin/layout/1/m19/images/favicon72.png
Allow: /data/skin/layout/1/m19/images/favicon144.png

User-agent: Googlebot
Allow:/

User-agent: Mediapartners-Google
Allow:/

User-agent: AdsBot-Google
Allow:/

History

Changes recorded since June 2026.

No change recorded.

In context

South Korea
34.6% block at least one AI crawler
Behind Cloudflare
No