CrawlerPulse
CrawlerPulse / North America / Cuba / radiorebelde.cu

radiorebelde.cu

radiorebelde.cu · Cuba · measured 8 Oct 2026

Google Search
Allowed
Google-Extended
Allowed
OpenAI
Allowed
Anthropic
Allowed
Perplexity
Allowed
Meta
Allowed
Common Crawl
Allowed
ByteDance
Allowed
Apple
Allowed
Amazon
Allowed

robots.txt

As read on 8 Oct 2026, 1,377 bytes. No rule names an AI crawler.

User-agent: *
Allow: /
Disallow: /chuncha/
Disallow: /amigos_rebelde/index.php
Disallow: /english/world/
Disallow: /english/science/
Disallow: /english/cuba/
Disallow: /english/sports/
Disallow: /english/economy/
Disallow: /english/cultural/
Disallow: /english/more/
Disallow: /foro.htm
Disallow: /historia.htm
Disallow: /infografia.htm
Disallow: /solidaridad/
Disallow: /cinco_anterior-eng.html
Disallow: /cinco/noticias/cinco-anterior-09.html
Disallow: /cinco-anterior.html
Disallow: /cinco/noticias/
Disallow: /english/more.html
Disallow: /anteriores-eng.html
Disallow: /cinco.htm
Disallow: /default_ing.htm
Disallow: /historia.htm
Disallow: /ayuda_ing.htm
Disallow: /cinco/biografias/cinco_biografias_rene_ing.htm
Disallow: /english/default.htm
Disallow: /english/more/more-09.html
Disallow: /english/noticias_radiorebelde_eng.xml
Disallow: /mensajes/amigos_rebelde_inicio.php
Disallow: /mensajes/facebook_inicio.php
Disallow: /mensajes/pena_taque_inicio.php
Disallow: /includes/
Disallow: /48snb/pena-taque.php
Disallow: /noticias/deportivas/deportivas2-160908-eng.html
Disallow: /noticias/deportivas/deportivas2-180908-eng.html
Disallow: /noticias/nacionales/nacionales2-020908-eng.htm
Disallow: /tophits_ing.htm
Disallow: /administrator/
Sitemap: https://radiorebelde.cu/sitemap_index.xml

History

Changes recorded since June 2026.

No change recorded.

In context

Cuba
2.6% block at least one AI crawler
Behind Cloudflare
No