CrawlerPulse
CrawlerPulse / Asia / South Korea / joongang.co.kr

JoongAng-ilbo

joongang.co.kr · South Korea · Joongang · measured 8 Oct 2026

Google Search
Allowed
Google-Extended
Allowed
OpenAI
Blocked
Anthropic
Blocked
Perplexity
Allowed
Meta
Blocked
Common Crawl
Blocked
ByteDance
Blocked
Apple
Blocked
Amazon
Blocked

robots.txt

As read on 8 Oct 2026, 5,818 bytes. 2 rule groups name AI crawlers; shown first.

User-agent: Google-Extended
User-agent: Gemini-Deep-Research
User-agent: Google-NotebookLM
User-agent: Google-Agent
User-agent: GoogleAgent-URLContext
User-agent: ChatGPT-User
User-agent: OAI-SearchBot
User-agent: PerplexityBot
User-agent: Perplexity-User
User-agent: Claude-Web
User-agent: Claude-SearchBot
User-agent: Claude-User
User-agent: Applebot
Allow: /

User-agent: Google-CloudVertexBot
User-agent: TelegramBot
User-agent: GPTBot
User-agent: ClaudeBot
User-agent: anthropic-ai
User-agent: Applebot-Extended
User-agent: Bytespider
User-agent: TikTokSpider
User-agent: Meta-ExternalAgent
User-agent: meta-externalfetcher
User-agent: FacebookBot
User-agent: Amazonbot
User-agent: PanguBot
User-agent: GoogleOther
User-agent: cohere-ai
User-agent: Ai2Bot
User-agent: Ai2Bot-Dolma
User-agent: CCBot
User-agent: Omgilibot
User-agent: Omgili
User-agent: Webzio-Extended
User-agent: Diffbot
User-agent: Scrapy
User-agent: img2dataset
User-agent: ImagesiftBot
User-agent: TurnitinBot
User-agent: DataForSeoBot
User-agent: AwarioBot
User-agent: AwarioSmartBot
User-agent: AwarioRssBot
User-agent: AhrefsBot
User-agent: BLEXBot
User-agent: SemrushBot-OCOB
User-agent: Sentibot
User-agent: Kangaroo Bot
User-agent: Timpibot
User-agent: FriendlyCrawler
User-agent: ICC-Crawler
User-agent: PetalBot
User-agent: VelenPublicWebCrawler
User-agent: Applebot-Extended
User-agent: DuckAssistBot
User-agent: ImagesiftBot
User-agent: Meta-ExternalFetcher
User-agent: YouBot
User-agent: DeepSeekBot
User-agent: YisouSpider
User-agent: proximic
User-agent: ExaSearchBot
Disallow: /

User-agent: *
Disallow: /_TP/
Disallow: /_CP/
Disallow: /_CT/
Disallow: /_dts/
Disallow: /election2022/
Disallow: /purchase/
Disallow: /unsubscribe/
Disallow: /share/
Disallow: /search
Disallow: /aisearch
Disallow: /jtour/
Disallow: /jebo/
Disallow: /moappapi/
Disallow: /conference/
Disallow: /gmc/part
Disallow: /article/2792431
Disallow: /article/2784727
Disallow: /article/2764507
Disallow: /article/2765837
Disallow: /article/25095140
Disallow: /article/25095366
Disallow: /article/13150451
Disallow: /article/13118107
Disallow: /article/12078543
Disallow: /article/3217247
Disallow: /dataedit/
Disallow: /preview/
Disallow: /election2022/elected/
Disallow: /election2022/candidates/
Disallow: /digitalspecial/210
Disallow: /digitalspecial/342
Disallow: /digitalspecial/168
Disallow: /digitalspecial/82
Disallow: /ext/

User-agent: *
Allow: /sitemap/
Sitemap: https://www.joongang.co.kr/sitemap/sections
Sitemap: https://www.joongang.co.kr/sitemap/articles/2026/
Sitemap: https://www.joongang.co.kr/sitemap/articles/2025/
Sitemap: https://www.joongang.co.kr/sitemap/articles/2024/
Sitemap: https://www.joongang.co.kr/sitemap/articles/2023/
Sitemap: https://www.joongang.co.kr/sitemap/articles/2022/
Sitemap: https://www.joongang.co.kr/sitemap/articles/2021/
Sitemap: https://www.joongang.co.kr/sitemap/articles/2020/
Sitemap: https://www.joongang.co.kr/sitemap/articles/2019/
Sitemap: https://www.joongang.co.kr/sitemap/articles/2018/
Sitemap: https://www.joongang.co.kr/sitemap/articles/2017/
Sitemap: https://www.joongang.co.kr/sitemap/articles/2016/
Sitemap: https://www.joongang.co.kr/sitemap/articles/2015/
Sitemap: https://www.joongang.co.kr/sitemap/articles/2014/
Sitemap: https://www.joongang.co.kr/sitemap/articles/2013/
Sitemap: https://www.joongang.co.kr/sitemap/articles/2012/
Sitemap: https://www.joongang.co.kr/sitemap/articles/2011/
Sitemap: https://www.joongang.co.kr/sitemap/articles/2010/
Sitemap: https://www.joongang.co.kr/sitemap/articles/2009/
Sitemap: https://www.joongang.co.kr/sitemap/articles/2008/
Sitemap: https://www.joongang.co.kr/sitemap/articles/2007/
Sitemap: https://www.joongang.co.kr/sitemap/articles/2006/
Sitemap: https://www.joongang.co.kr/sitemap/articles/2005/
Sitemap: https://www.joongang.co.kr/sitemap/articles/2004/
Sitemap: https://www.joongang.co.kr/sitemap/articles/2003/
Sitemap: https://www.joongang.co.kr/sitemap/articles/2002/
Sitemap: https://www.joongang.co.kr/sitemap/articles/2001/
Sitemap: https://www.joongang.co.kr/sitemap/images/2026/
Sitemap: https://www.joongang.co.kr/sitemap/images/2025/
Sitemap: https://www.joongang.co.kr/sitemap/images/2024/
Sitemap: https://www.joongang.co.kr/sitemap/images/2023/
Sitemap: https://www.joongang.co.kr/sitemap/images/2022/
Sitemap: https://www.joongang.co.kr/sitemap/images/2021/
Sitemap: https://www.joongang.co.kr/sitemap/images/2020/
Sitemap: https://www.joongang.co.kr/sitemap/images/2019/
Sitemap: https://www.joongang.co.kr/sitemap/images/2018/
Sitemap: https://www.joongang.co.kr/sitemap/images/2017/
Sitemap: https://www.joongang.co.kr/sitemap/images/2016/
Sitemap: https://www.joongang.co.kr/sitemap/latest-articles
Sitemap: https://www.joongang.co.kr/sitemap/etc
Sitemap: https://www.joongang.co.kr/sitemap/plus-articles/2026/
Sitemap: https://www.joongang.co.kr/sitemap/plus-articles/2025/
Sitemap: https://www.joongang.co.kr/sitemap/plus-articles/2024/
Sitemap: https://www.joongang.co.kr/sitemap/plus-articles/2023/
Sitemap: https://www.joongang.co.kr/sitemap/plus-articles/2022/
Sitemap: https://www.joongang.co.kr/sitemap/plus-articles/2021/
Sitemap: https://www.joongang.co.kr/sitemap/latest-plus-articles

History

Changes recorded since June 2026.

No change recorded.

In context

South Korea
34.6% block at least one AI crawler
Behind Cloudflare
No