CrawlerPulse
CrawlerPulse / South America / Peru / rpp.pe

RPP Noticias

rpp.pe · Peru · Grupo RPP · measured 8 Oct 2026

Google Search
Allowed
Google-Extended
Blocked
OpenAI
Blocked
Anthropic
Blocked
Perplexity
Allowed
Meta
Allowed
Common Crawl
Blocked
ByteDance
Blocked
Apple
Allowed
Amazon
Blocked

robots.txt

As read on 8 Oct 2026, 2,023 bytes. 1 rule group name AI crawlers; shown first.

User-agent: GPTBot
User-agent: CCBot
User-agent: anthropic-ai
User-agent: Claudebot
User-agent: Bytespider
User-agent: Amazonbot
User-agent: FacebookBot
User-agent: cohere-ai
User-agent: DataForSeoBot
User-agent: Diffbot
User-agent: omgili
User-agent: omgilibot
User-agent: YouBot
User-agent: SemrushBot
User-agent: dotbot
User-agent: MJ12bot
User-agent: Rogerbot
User-agent: Scrapy
User-agent: TurnitinBot
User-agent: magpie-crawler
User-agent: NewsNow
User-agent: news-please
User-agent: AwarioRssBot
User-agent: AwarioSmartBot
User-agent: PiplBot
User-agent: Google-Extended
Disallow: /

User-agent: *
Disallow: /alert*
Disallow: /buscar/*
Disallow: /contactenos/*
Disallow: /archivo/*/19*
Disallow: /archivo/*/200*
Disallow: /archivo/*/201*
Disallow: /archivo/*/2020*
Disallow: /sitemap/archivos/
Disallow: */permalink/*
Disallow: /p/*
Disallow: /tema*
Disallow: /amp/*
Disallow: /basics/*
Disallow: /capitaltema*
Disallow: /https://
Disallow: /filecdn.php*
Disallow: /assets/img/cont-especial.png
Disallow: /minimedia.php*
Disallow: /capitalcache/
Disallow: /capitalradio/
Disallow: /pict.php*
Disallow: /viewnew.php*
Sitemap: https://rpp.pe/sitemap/news
Sitemap: https://rpp.pe/sitemap/web
Sitemap: https://rpp.pe/sitemap/web/politica
Sitemap: https://rpp.pe/sitemap/web/actualidad
Sitemap: https://rpp.pe/sitemap/web/peru
Sitemap: https://rpp.pe/sitemap/web/mundo
Sitemap: https://rpp.pe/sitemap/web/tecnologia
Sitemap: https://rpp.pe/sitemap/web/economia
Sitemap: https://rpp.pe/sitemap/web/futbol
Sitemap: https://rpp.pe/sitemap/web/famosos
Sitemap: https://rpp.pe/sitemap/web/cine
Sitemap: https://rpp.pe/sitemap/web/lima
Sitemap: https://rpp.pe/sitemap/web/capital

History

Changes recorded since June 2026.

No change recorded.

In context

Peru
10.3% block at least one AI crawler
Behind Cloudflare
No
Same group