thechronicle.com.au · Australia · News Corp AU · measured 8 Oct 2026
As read on 8 Oct 2026, 3,312 bytes. 2 rule groups name AI crawlers; shown first.
User-agent: ScreamingFrogSEOSpider User-agent: proximic User-agent: Outbrain User-agent: Yahoo Ad monitoring User-agent: SemrushBot User-agent: facebookexternalhit User-agent: ias_crawler User-agent: identrics User-agent: MeltwaterNews User-agent: links.streem.com.au User-agent: LinkedInBot User-agent: redditbot User-agent: Mediapartners-Google User-agent: Google-InspectionTool User-agent: Adsbot-Google User-agent: Storebot-Google User-agent: AdsBot-Google-Mobile User-agent: AdsBot-Google-Mobile-Apps User-agent: APIs-Google User-agent: Google-Ads-Creatives-Assistant User-agent: Google-adwords User-agent: Google-amphtml User-agent: Google-cloudvertexbot User-agent: Google-play-newsstand User-agent: Google-read-aloud User-agent: Google-Safety User-agent: Google-site-verification User-agent: Google-Structured-Data-Testing-Tool User-agent: Googleimageproxy User-agent: Applebot User-agent: AppleNewsBot User-agent: adidxbot User-agent: admantx User-agent: admantx-usbatch/3.1 User-agent: AmazonAdBot User-agent: Chrome-Lighthouse User-agent: Verity User-agent: Leikibot User-agent: parselybot User-agent: peer39_crawler/1.0 User-agent: pingdom User-agent: Pinterestbot User-agent: proximic User-agent: PubMatic Crawler Bot User-agent: Mobian User-agent: Slack-ImgProxy User-agent: Slackbot User-agent: Slackbot-LinkExpanding User-agent: thetradedesk User-agent: Uptimebot User-agent: yahoo-linkpreview Disallow: ========================== User-agent: Google-Extended Disallow: / User-agent: Googlebot User-agent: Googlebot-Image User-agent: Googlebot-News User-agent: Googlebot-Video User-agent: GoogleOther User-agent: GoogleOther-Image User-agent: GoogleOther-Video User-agent: Bingbot User-agent: bingpreview User-agent: MicrosoftPreview User-agent: DuckDuckBot User-agent: Slurp User-agent: yahoo Disallow: Disallow: /*?expand_comments=true Disallow: /*&expand_comments=true Disallow: /404 Disallow: /akam/ Disallow: /*suburb= Disallow: /*rsf= Disallow: /*page= Disallow: /*?from= Disallow: /*campaignName= Disallow: /*?gclid= Disallow: /*?advertiser= Disallow: /*?utm_source= Disallow: /*/add-to-calendar/ Disallow: /sport/superracing/form-guide Disallow: /sport/superracing/form-guide/* Disallow: /archive/ Disallow: /it-test-only/ Disallow: /it-test-only/* Disallow: /enewsletters/ Disallow: /*match?matchid= Disallow: /classifieds/*?sort= Disallow: /classifieds/*?show= Disallow: /classifieds/*?page= Disallow: /*?fbclid= Disallow: /*&fbclid= Disallow: /*?nk= Disallow: /tributes/*?page= Disallow: /tributes/*?sort= Disallow: /tributes/*?show= Disallow: /tributes/*?nk= User-agent: * Allow: /ads.txt Allow: /app-ads.txt Disallow: / Sitemap: https://www.thechronicle.com.au/sitemap.xml Sitemap: https://www.thechronicle.com.au/news-sitemap.xml
Changes recorded since June 2026.
No change recorded.