harianjogja.com · Indonesia · PT. Aksara Dinamika Jogja · measured 8 Oct 2026
As read on 8 Oct 2026, 3,020 bytes. 10 rule groups name AI crawlers; shown first.
User-agent: FacebookBot Allow: / User-agent: GPTBot Disallow: / User-agent: ChatGPT-User Disallow: / User-agent: Google-Extended Disallow: / User-agent: anthropic-ai Disallow: / User-agent: Claude-Web Disallow: / User-agent: cohere-ai Disallow: / User-agent: PerplexityBot Disallow: / User-agent: YouBot Disallow: / User-agent: PetalBot Disallow: / User-agent: * Allow: / Disallow: /admin/ Disallow: /login/ Disallow: /dashboard/ Disallow: /api/ Disallow: /tmp/ Disallow: /cache/ Disallow: /includes/ Disallow: /config/ Disallow: /?s= Disallow: /?p= Disallow: /search/ Crawl-delay: 5 User-agent: Googlebot Allow: / Disallow: /admin/ Disallow: /login/ Crawl-delay: 2 User-agent: Googlebot-Image Allow: / Allow: /images/ Allow: /uploads/ Crawl-delay: 2 User-agent: googlebot-mobile Allow: / User-agent: Googlebot-News Allow: / Disallow: /tag/ Disallow: /author/ Crawl-delay: 1 User-agent: Googlebot-Video Allow: / Crawl-delay: 2 User-agent: AdsBot-Google Allow: / User-agent: Bingbot Allow: / Disallow: /admin/ Crawl-delay: 3 User-agent: Slurp Allow: / Crawl-delay: 5 User-agent: DuckDuckBot Allow: / Crawl-delay: 3 User-agent: Yandex Allow: / Crawl-delay: 5 User-agent: Applebot Allow: / Crawl-delay: 3 User-agent: facebookexternalhit Allow: / User-agent: Twitterbot Allow: / User-agent: LinkedInBot Allow: / User-agent: Pinterest Allow: / User-agent: WhatsApp Allow: / User-agent: TelegramBot Allow: / User-agent: AhrefsBot Allow: / User-agent: SemrushBot Allow: / User-agent: MJ12bot Disallow: / User-agent: DotBot Disallow: / User-agent: Gigabot Disallow: / User-agent: ia_archiver Disallow: / User-agent: baiduspider Disallow: / User-agent: naverbot Disallow: / User-agent: yeti Disallow: / User-agent: psbot Disallow: / User-agent: MegaIndex Disallow: / User-agent: BLEXBot Disallow: / User-agent: DataForSeoBot Disallow: / Sitemap: https://www.harianjogja.com/sitemap.xml Sitemap: https://www.harianjogja.com/sitemap-arsip.xml
Changes recorded since June 2026.
No change recorded.