Sky News Australia

User-agent: ScreamingFrogSEOSpider
User-agent: proximic
User-agent: Outbrain
User-agent: Yahoo Ad monitoring
User-agent: SemrushBot
User-agent: facebookexternalhit
User-agent: ias_crawler
User-agent: identrics
User-agent: MeltwaterNews
User-agent: links.streem.com.au
User-agent: LinkedInBot
User-agent: redditbot
User-agent: Mediapartners-Google
User-agent: Google-InspectionTool
User-agent: Adsbot-Google
User-agent: Storebot-Google
User-agent: AdsBot-Google-Mobile
User-agent: AdsBot-Google-Mobile-Apps
User-agent: APIs-Google
User-agent: Google-Ads-Creatives-Assistant
User-agent: Google-adwords
User-agent: Google-amphtml
User-agent: Google-cloudvertexbot
User-agent: Google-play-newsstand
User-agent: Google-read-aloud
User-agent: Google-Safety
User-agent: Google-site-verification
User-agent: Google-Structured-Data-Testing-Tool
User-agent: Googleimageproxy
User-agent: Applebot
User-agent: AppleNewsBot
User-agent: adidxbot
User-agent: admantx
User-agent: admantx-usbatch/3.1
User-agent: AmazonAdBot
User-agent: Chrome-Lighthouse
User-agent: Verity
User-agent: Leikibot
User-agent: parselybot
User-agent: peer39_crawler/1.0
User-agent: pingdom
User-agent: Pinterestbot
User-agent: proximic
User-agent: PubMatic Crawler Bot
User-agent: Mobian
User-agent: Slack-ImgProxy
User-agent: Slackbot
User-agent: Slackbot-LinkExpanding
User-agent: thetradedesk
User-agent: Uptimebot
User-agent: yahoo-linkpreview
User-agent: Taboolabot
User-agent: Twitterbot
Disallow:

User-agent: Google-Extended
Disallow: /

User-agent: Googlebot
User-agent: Googlebot-Image
User-agent: Googlebot-News
User-agent: Googlebot-Video
User-agent: GoogleOther
User-agent: GoogleOther-Image
User-agent: GoogleOther-Video
User-agent: Bingbot
User-agent: bingpreview
User-agent: MicrosoftPreview
User-agent: DuckDuckBot
User-agent: Slurp
User-agent: yahoo
Disallow: /*?expand_comments=true
Disallow: /*&expand_comments=true
Disallow: /*/comments-*
Disallow: /*/print/
Disallow: /*SIT*
Disallow: /*.swf
Disallow: /printpage/
Disallow: /404
Disallow: /details/*
Disallow: /*?nk=
Disallow: /akam/
Disallow: /*?id=
Disallow: /*?ref=
Disallow: /*?cid=
Disallow: /*?fbclid=
Disallow: /*?utm_source=
Disallow: /*?preview=

User-agent: *
Allow: /ads.txt
Allow: /app-ads.txt
Disallow: /
Sitemap: https://www.news24.com.au/sitemap.xml
Sitemap: https://www.news24.com.au/news-sitemap.xml
Sitemap: https://www.news24.com.au/video-horizontal-sitemap.xml
Sitemap: https://www.news24.com.au/video-vertical-sitemap.xml

No change recorded.