CrawlerPulse
CrawlerPulse / Europe / United Kingdom / lawgazette.co.uk

The Law Society Gazette

lawgazette.co.uk · United Kingdom · measured 9 Oct 2026

Google Search
Allowed
Google-Extended
Allowed
OpenAI
Allowed
Anthropic
Allowed
Perplexity
Allowed
Meta
Allowed
Common Crawl
Allowed
ByteDance
Allowed
Apple
Allowed
Amazon
Allowed

robots.txt

As read on 9 Oct 2026, 723 bytes. No rule names an AI crawler.

User-agent: *
Disallow: /register$
Disallow: /searchresults
Disallow: /solrsearchresults
Disallow: /sign-out
Disallow: /sign-in
Disallow: /attachment$
Disallow: /reporttomoderator
Disallow: /download$
Disallow: /forgotten-password
Disallow: /my-account/*
Disallow: /my-account
Disallow: /*.publicprofile
Disallow: /ajax/*
Disallow: /api/*
Disallow: /mysaved
Disallow: /bookmark$
Disallow: /*?userid=
Disallow: /*?uc=
Disallow: /sitedashboard/*
Disallow: /swagger/*
Disallow: /CookiePolicy.aspx
Disallow: /SystemCheck.aspx
Disallow: /Attachments_Advert.aspx
Disallow: /navsectionFullRSS.aspx
Disallow: /*.fullrss
Disallow: /navsectionRSS.aspx
Disallow: /*.rss
Sitemap: https://www.lawgazette.co.uk/GoogleSiteMapIndex.aspx

History

Changes recorded since June 2026.

No change recorded.

In context

United Kingdom
73.8% block at least one AI crawler
Behind Cloudflare
No