CrawlerPulse
CrawlerPulse / Europe / United Kingdom / s4c.cymru

Newyddion

s4c.cymru · United Kingdom · measured 9 Oct 2026

Google Search
Allowed
Google-Extended
Allowed
OpenAI
Allowed
Anthropic
Allowed
Perplexity
Allowed
Meta
Allowed
Common Crawl
Allowed
ByteDance
Allowed
Apple
Allowed
Amazon
Allowed

robots.txt

As read on 9 Oct 2026, 1,806 bytes. No rule names an AI crawler.

User-agent: *
Disallow: /production/downloads/
Disallow: /guidelines/
Disallow: /testClic/
Disallow: /sami/
Disallow: /nadolig-2009/
Disallow: /nadoligcyw-2009/
Disallow: /search/
Disallow: /arwelblog/
Disallow: /clic/e_live-full.shtml
Disallow: /login_script/
Disallow: /plantyplas/
Disallow: /dysgwyr/rhaglen/hacio
Disallow: /abouts4c/corporate/pdf/Code_of_Complaints_v6.5Wel.pdf
Disallow: /abouts4c/corporate/pdf/Code_of_Complaints_v6.5Eng.pdf
Disallow: /en/competitions/
Disallow: /cy/cystadlaethau/
Disallow: /en/s4c-digital-and-commercial/
Disallow: /cy/s4c-digidol-a-masnachol/
Disallow: /en/explore/page/12457/websites-a-z-34/
Disallow: /cy/pori/page/12457/gwefannau-a-y-34/
Disallow: /argyfwng/
Disallow: /en/s4c-commercial/
Disallow: /cy/s4c-masnachol/
Disallow: /en/example/
Disallow: /cy/enghraifft/
Disallow: /en/archive/
Disallow: /cy/archif/
Disallow: /en/z-archive/
Disallow: /cy/z-archif/
Disallow: /en/z-templates/
Disallow: /cy/z-templedi/
Disallow: /en/stwnsh-old/
Disallow: /cy/stwnsh-old/
Disallow: /en/stwnsh/tag/
Disallow: /cy/stwnsh/tag/
Disallow: /en/emergency/
Disallow: /cy/argyfwng/
Disallow: /en/clic-promotions/
Disallow: /cy/hyrwyddiadau-clic/
Disallow: /en/listings/
Disallow: /cy/amserlenni/
Disallow: /en/press-beta/
Disallow: /cy/y-wasg-beta/
Disallow: /en/podcasts/tags/
Disallow: /cy/podlediadau/tags/
Disallow: /en/entertainment/gwylior-sr-yn-fyw/
Disallow: /cy/adloniant/gwylior-sr-yn-fyw/
Disallow: /media/media_assets/2016.04.07_Ymrwymiad_i_Amrywiaeth_-_Final_-_Clean.pdf
Disallow: /en/entertainment/popt/
Disallow: /cy/adloniant/popt/
Disallow: /en/academi/
Disallow: /cy/academi/
Disallow: /en/archive/cn-i-gymru-2012/page/49081/experience-date/
Disallow: /cy/archif/cn-i-gymru-2012/page/49081/profiad/
Disallow: */tags/
Disallow: /google-verification/
Allow: /

History

Changes recorded since June 2026.

No change recorded.

In context

United Kingdom
73.8% block at least one AI crawler
Behind Cloudflare
No