coastcommunitynews.com.au · Australia · Coast Community News · measured 8 Oct 2026
As read on 8 Oct 2026, 939 bytes. 6 rule groups name AI crawlers; shown first.
User-agent: GPTBot Disallow: / User-agent: ImagesiftBot Disallow: / User-agent: GPTBot Disallow: / User-agent: CCBot Disallow: / User-agent: ClaudeBot Disallow: / User-agent: PetalBot Disallow: / User-agent: * Disallow: /wp-content/cache/ Disallow: /wp-admin/ Disallow: /?s= Disallow: /search/ User-agent: AhrefsBot Disallow: / User-agent: SemrushBot Disallow: / User-agent: BLEXBot Disallow: / User-agent: AwarioRssBot Disallow: / User-agent: AwarioSmartBot Disallow: / User-agent: MJ12Bot Disallow: / User-agent: DataForSeoBot Disallow: / User-agent: Claude-User Disallow: / User-agent: Claude-SearchBot Disallow: / User-agent: trendictionbot Disallow: / User-agent: LamarkBot Disallow: / User-agent: Barkrowler Disallow: / User-agent: Baiduspider Disallow: / User-agent: AliyunSecBot Disallow: / User-agent: AliyunSecBot/Aliyun Disallow: / User-agent: AliyunSecBot/Nutch-1.21-SNAPSHOT Disallow: /
Changes recorded since June 2026.