The Corowa free press

corowafreepress.com.au · Australia · McPherson Newspapers Pty Ltd · measured 8 Oct 2026

Google Search

Allowed

Google-Extended

Allowed

OpenAI

Allowed

Anthropic

Allowed

Perplexity

Allowed

robots.txt

As read on 8 Oct 2026, 185 bytes. 1 rule group name AI crawlers; shown first.

User-agent: AhrefsBot
User-agent: Java-http-client
User-agent: SemrushBot
User-agent: Bytespider
Disallow: /

User-agent: *
Crawl-Delay: 30
Disallow: /wp-admin/
Disallow: /wp-includes/

History

Changes recorded since June 2026.

No change recorded.

In context

Australia

34.0% block at least one AI crawler

Behind Cloudflare

Same group

benallaensign.com.au, campaspenews.com.au, cobramcourier.com.au, denipt.com.au, kyfreepress.com.au, riverineherald.com.au, seymourtelegraph.com.au, sheppnews.com.au, southernriverinanews.com.au, yarrawongachronicle.com.au