metroseoul.co.kr · South Korea · Metro - South Korea · measured 8 Oct 2026
As read on 8 Oct 2026, 1,014 bytes. 5 rule groups name AI crawlers; shown first.
User-agent: GPTBot Disallow: / User-agent: ClaudeBot Disallow: / User-agent: Bytespider Disallow: / User-agent: CCBot Disallow: / User-agent: PetalBot Disallow: / User-agent: * Disallow: /newsList/11 User-agent: Mediapartners-Google Allow: / User-agent: Googlebot Allow: / Crawl-delay: 3600 User-agent: Googlebot-News Allow: / User-agent: Googlebot-Mobile Allow: / User-Agent: Adsbot-Google Allow: / User-agent: Daumoa-image Allow: / User-agent: bingbot Crawl-delay: 3600 User-agent: Slurp Disallow: / User-agent: Yahoo-MMCrawler Disallow: / User-agent: YandexBot Disallow: / User-agent: SemrushBot Disallow: / User-agent: Yeti Disallow: / User-agent: AhrefsBot Disallow: / User-agent: DotBot Disallow: / User-agent: DataForSeoBot Disallow: / User-agent: SemanticBot Disallow: / User-agent: BLEXBot Disallow: / User-agent: trendictionbot Disallow: / User-agent: Mail.RU_Bot Disallow: / User-agent: ScooperBot Disallow: / User-agent: FuseonBot Disallow: / User-agent: MJ12bot Disallow: /
Changes recorded since June 2026.
No change recorded.