shetnews.co.uk

shetnews.co.uk · United Kingdom · measured 8 Oct 2026

Google Search

Allowed

Google-Extended

Allowed

OpenAI

Allowed

Anthropic

Allowed

Perplexity

Allowed

robots.txt

As read on 8 Oct 2026, 370 bytes. No rule names an AI crawler.

License: https://www.shetnews.co.uk/license.xml

User-agent: *
tdl: https://m4ow.uk/socw/2.txt
Disallow: /wp-admin/
Allow: /wp-admin/admin-ajax.php
Disallow: /wp-content/plugins/
Disallow: /wp-content/themes/shetlandnews/vendor/
Disallow: /wp-content/themes/shetlandnews/node_modules/
Sitemap: https://www.shetnews.co.uk/sitemap.xml

History

Changes recorded since June 2026.

No change recorded.

In context

United Kingdom

73.8% block at least one AI crawler

Behind Cloudflare

Same group

deeside.com, hambletontoday.co.uk, armaghi.com, barnetpost.co.uk, bedfordindependent.co.uk, bridlingtonecho.co.uk, brightonandhovenews.org, caerphilly.observer, cwmbranlife.co.uk, eastleighnews.co.uk, enfielddispatch.co.uk, gedlingeye.co.uk