ajc.com · United States · Cox Media Group Inc · measured 8 Oct 2026
As read on 8 Oct 2026, 1,598 bytes. No rule names an AI crawler.
User-agent: * Disallow: /search Disallow: /google-search Disallow: /flatpage- Disallow: /*_ptid= Disallow: /media/mp4/ Sitemap: https://feeds.ajc.com/arc/outboundfeeds/sitemap-index/?outputType=xml Sitemap: https://feeds.ajc.com/arc/outboundfeeds/video-sitemap/?outputType=xml Sitemap: https://feeds.ajc.com/arc/outboundfeeds/news-sitemap/?outputType=xml Sitemap: https://www.ajc.com/pages-sitemap.xml User-agent: Twitterbot Disallow: User-agent: bingbot Crawl-delay: 10 User-agent: AhrefsbBot Crawl-delay: 15 User-agent: SemrushBot Crawl-delay: 15 User-agent: BLEXBot Crawl-delay: 15 User-agent: MJ12bot Crawl-delay: 15 User-agent: AmazonAdBot Crawl-delay: 15 User-agent: Pinterestbot Crawl-delay: 15 User-agent: trendictionbot Crawl-delay: 15 User-agent: NTENTbot Crawl-delay: 15 User-agent: DotBot Crawl-delay: 15 User-agent: rogerbot Crawl-delay: 15 User-Agent: Exabot Crawl-delay: 15 User-agent: GetIntent Crawler Crawl-delay: 15 User-agent: Yandex Disallow: / User-agent: YandexMobileBot Disallow: / User-agent: PhantomJS Disallow: / User-agent: SputnikBot Disallow: / User-agent: SeznamBot Disallow: / User-agent: Cliqzbot Disallow: / User-agent: Mail.RU_Bot Disallow: / User-agent: Baiduspider Disallow: / User-agent: Baiduspider-video Disallow: / User-agent: Baiduspider-image Disallow: / User-agent: SentiBot Disallow: / User-agent: MauiBot (crawler.feedback+wc@gmail.com) Disallow: / User-agent: Mappy Disallow: / User-Agent: WotBot Disallow: /
Changes recorded since June 2026.
No change recorded.