CrawlerPulse
CrawlerPulse / Europe / Switzerland / rsi.ch

rsi.ch

rsi.ch · Switzerland · measured 8 Oct 2026

Google Search
Allowed
Google-Extended
Allowed
OpenAI
Blocked
Anthropic
Blocked
Perplexity
Allowed
Meta
Blocked
Common Crawl
Blocked
ByteDance
Blocked
Apple
Blocked
Amazon
Blocked

robots.txt

As read on 8 Oct 2026, 5,483 bytes. 12 rule groups name AI crawlers; shown first.

User-agent: Amazonbot
Disallow: /

User-agent: applebot-extended
Disallow: /

User-agent: bytespider
Disallow: /

User-agent: ccbot
Disallow: /

User-agent: claudebot
Disallow: /

User-agent: deepseekbot
Disallow: /

User-agent: diffbot
Disallow: /

User-agent: facebookbot
Disallow: /

User-agent: meta-externalagent
Disallow: /

User-agent: gptbot
Disallow: /

User-agent: omgili
Disallow: /

User-agent: omgilibot
Disallow: /

User-agent: *
Allow: /
Disallow: /api/*
Disallow: /ece-cue/*
Disallow: /ECE-CUE/*
Disallow: /intranet/
Disallow: /la1/*
Disallow: /la2/*
Disallow: /live-radio/*
Disallow: /monitor/*
Disallow: /programmiaz/*
Disallow: /promo/*
Disallow: /search/*
Disallow: /speciali/*
Disallow: /srg/*
Disallow: /tasto-rosso/*
Disallow: /incoming/*
Disallow: /https://www.rsi.ch/kids/scelta/piccoli/serie/?id*
Disallow: /https://www.rsi.ch/kids/scelta/grandi/serie/?id*
Disallow: /https://www.rsi.ch/kids/scelta/piccoli/player/?id*
Disallow: /https://www.rsi.ch/kids/scelta/grandi/player/?id*
Disallow: /trash/*
Disallow: /info/redazione/
Disallow: /*?f=podcast-xml
Disallow: /*1000
Disallow: /web/*
Disallow: /cook-api/*
Allow: /generic-static/sitemap/
Disallow: /generic-static/
Disallow: /others/*
Disallow: /ricerca/*
Allow: /web/podcast/*
Allow: /speciali/comunicazione/vendite/*
Allow: /la1/programmi/informazione/patti-chiari/*
allow: /play/*
disallow: /play/tv/nowandnext
disallow: /play/tv/trasmissioni-per-data/oneday
disallow: /play/tv/ricerca
disallow: /play/tv/ricerca/typeahead
disallow: /play/tv/video/mailvideo
disallow: /play/tv/popupvideoplayer
disallow: /play/tv/quicklink/*
disallow: /play/tv/redirect/detail/*
disallow: /play/tv/episodesfromshow
disallow: /play/videoplayer/inline/*
disallow: /play/tv/carouselvideosajax/mostviewed
disallow: /play/tv/carouselvideosajax/soonoffline
disallow: /play/tv/carouselvideosajax/specialevent
disallow: /play/tv/carouselvideosajax/last24h
disallow: /play/tv/carouselvideosajax/latest
disallow: /play/tv/carouselvideosajax/currentlywatched
disallow: /play/tv/carouselvideosajax/otherepisodes
disallow: /play/tv/socialcount/get/*
disallow: /play/tv/socialcount/count/*
disallow: /play/i/
disallow: /play/c/
disallow: /play/js/
disallow: /play/assets/*
disallow: /play/social/redirect
disallow: /play/fallbackimage/scale/width/*
disallow: /play/ping.xml
disallow: /test/*
disallow: /__test/*
disallow: /info/dossier/inchiesta-cocaina/
disallow: /rsi-api/service/tospeech/
Disallow: /la2/programmi/informazione/elezioni-cantonali-ticinesi-2019/*
Disallow: /web/prodotti/cultura/cult-plus/*
Disallow: /play/tv/patti-chiari/video/genio-in-21-giorni?urn=urn:rsi:video:1078348
Disallow: /info/mondo/Condannato-Renato-Soru--948654.html
Disallow: /la1/programmi/informazione/patti-chiari/Inchieste/inchieste-andate-in-onda/Genio-in-21-giorni--1078347.html
Disallow: /info/ticino-grigioni-e-insubria/Finanzieri-investiti-due-fermi--1007476.html
Disallow: /info/ticino-grigioni-e-insubria/Caso-Cosentino-tocca-BancaStato--1019715.html
Disallow: /info/ticino-grigioni-e-insubria/Fiduciari-ticinesi-è-tutto-ok--1019998.html
Disallow: /info/ticino-grigioni-e-insubria/Plastic-Group-una-condanna--935071.html
Disallow: /info/ticino-grigioni-e-insubria/Una-truffa-da-due-milioni--1260218.html
Disallow: /info/ticino-grigioni-e-insubria/Truffa-a-un%E2%80%99anziana-prosciolto-un-51enne--2411138.html
Disallow: /info/ticino-grigioni-e-insubria/Grosa-condanna-definitiva--927443.html
Disallow: /play/tv/rete-uno/video/raccontami-di-te-natascia-bandecchi?urn=urn:rsi:video:2238442
Disallow: /edu/Contatti-RSI-EDU--1780946.html

User-agent: Feedfetcher-Google
Disallow: /*?f=podcast-xml
Sitemap: https://sitemap.lrc.swisstxt.ch/sitemap.xml
Sitemap: https://www.rsi.ch/generic-static/sitemap/sitemapindex.xml

User-agent: cohere-training-data-crawler
Disallow: /

User-agent: deepseek
Disallow: /

User-agent: deepseek-crawler
Disallow: /

User-agent: grokbot
Disallow: /

User-agent: img2dataset
Disallow: /

User-agent: laiondownloader
Disallow: /

User-agent: mistralai-crawler
Disallow: /

User-agent: pangubot
Disallow: /

User-agent: webzio
Disallow: /

User-agent: webzio-Extended
Disallow: /

History

Changes recorded since June 2026.

No change recorded.

In context

Switzerland
45.8% block at least one AI crawler
Behind Cloudflare
No