Cairns Post

User-agent: ScreamingFrogSEOSpider
User-agent: proximic
User-agent: Outbrain
User-agent: Yahoo Ad monitoring
User-agent: SemrushBot
User-agent: facebookexternalhit
User-agent: ias_crawler
User-agent: identrics
User-agent: MeltwaterNews
User-agent: links.streem.com.au
User-agent: LinkedInBot
User-agent: redditbot
User-agent: Mediapartners-Google
User-agent: Google-InspectionTool
User-agent: Adsbot-Google
User-agent: Storebot-Google
User-agent: AdsBot-Google-Mobile
User-agent: AdsBot-Google-Mobile-Apps
User-agent: APIs-Google
User-agent: Google-Ads-Creatives-Assistant
User-agent: Google-adwords
User-agent: Google-amphtml
User-agent: Google-cloudvertexbot
User-agent: Google-play-newsstand
User-agent: Google-read-aloud
User-agent: Google-Safety
User-agent: Google-site-verification
User-agent: Google-Structured-Data-Testing-Tool
User-agent: Googleimageproxy
User-agent: Applebot
User-agent: AppleNewsBot
User-agent: adidxbot
User-agent: admantx
User-agent: admantx-usbatch/3.1
User-agent: AmazonAdBot
User-agent: Chrome-Lighthouse
User-agent: Verity
User-agent: Leikibot
User-agent: parselybot
User-agent: peer39_crawler/1.0
User-agent: pingdom
User-agent: Pinterestbot
User-agent: proximic
User-agent: PubMatic Crawler Bot
User-agent: Mobian
User-agent: Slack-ImgProxy
User-agent: Slackbot
User-agent: Slackbot-LinkExpanding
User-agent: thetradedesk
User-agent: Uptimebot
User-agent: yahoo-linkpreview
Disallow:
==========================

User-agent: Google-Extended
Disallow: /

User-agent: Googlebot
User-agent: Googlebot-Image
User-agent: Googlebot-News
User-agent: Googlebot-Video
User-agent: GoogleOther
User-agent: GoogleOther-Image
User-agent: GoogleOther-Video
User-agent: Bingbot
User-agent: bingpreview
User-agent: MicrosoftPreview
User-agent: DuckDuckBot
User-agent: Slurp
User-agent: yahoo
Disallow:
Disallow: /*?expand_comments=true
Disallow: /*&expand_comments=true
Disallow: /*/comments-*
Disallow: /akam/
Disallow: /404
Disallow: /enewsletters/*
Disallow: /doublerainbow/*
Disallow: /it-test-only/*
Disallow: /*match?matchid=
Disallow: /classifieds/*?sort=
Disallow: /classifieds/*?show=
Disallow: /classifieds/*?page=
Disallow: /*?fbclid=
Disallow: /*&fbclid=
Disallow: /*?nk=
Disallow: /tributes/*?page=
Disallow: /tributes/*?sort=
Disallow: /tributes/*?show=
Disallow: /tributes/*?nk=
Disallow: /*suburb=
Disallow: /*rsf=
Disallow: /*page=
Disallow: /*campaignName=
Disallow: /*?gclid=
Disallow: /*?utm_source=
Disallow: /*?advertiser=
Disallow: /*/add-to-calendar/

User-agent: *
Allow: /ads.txt
Allow: /app-ads.txt
Disallow: /
Sitemap: https://www.cairnspost.com.au/sitemap.xml
Sitemap: https://www.cairnspost.com.au/news-sitemap.xml

No change recorded.