CrawlerPulse
CrawlerPulse / South America / Peru / lahora.pe

Diario La Hora

lahora.pe · Peru · Diario La Hora – www.lahora.pe · measured 9 Oct 2026

Google Search
Allowed
Google-Extended
Blocked
OpenAI
Blocked
Anthropic
Blocked
Perplexity
Blocked
Meta
Blocked
Common Crawl
Blocked
ByteDance
Blocked
Apple
Blocked
Amazon
Blocked

robots.txt

As read on 9 Oct 2026, 2,283 bytes. 2 rule groups name AI crawlers; shown first.

User-agent: ChatGPT-User
Allow: /
Disallow: /buscador*
Disallow: /data
Disallow: /data/*
Disallow: /contactenos
Disallow: /*/pag/
Disallow: /*/pag/*
Disallow: /*/*/page/*
Disallow: /archive/*
Disallow: /archivo/*
Disallow: /node/*
Disallow: /taxonomy/term/*
Disallow: /assets/*
Disallow: /files/*
Disallow: /comment/reply/*
Disallow: /envivo/*
Disallow: /*/tag/*
Disallow:*/*Perú
Disallow:*/Encuesta*
Disallow:*/EMPRESA/*
Disallow:*ref=photogallery*
Disallow: */sitemaps/*
Disallow: */pf/*
Allow: /sitemap/
Allow: /sitemap/*
Allow: /sitemaps/*
Allow: /rss/
Allow: /rss/*

User-agent: PetalBot
User-agent: UbiCrawler
User-agent: DOC
Disallow: /

User-agent: *
Disallow: /

User-agent: Googlebot
User-agent: Googlebot-News
User-agent: Googlebot-Image
User-agent: Googlebot-Video
User-agent: Googlebot-Mobile
User-agent: facebookexternalhit
Allow: /

User-agent: Zao
Disallow: /

User-agent: sitecheck.internetseer.com
Disallow: /

User-agent: Zealbot
Disallow: /

User-agent: MSIECrawler
Disallow: /

User-agent: SiteSnagger
Disallow: /

User-agent: WebStripper
Disallow: /

User-agent: WebCopier
Disallow: /

User-agent: Fetch
Disallow: /

User-agent: Offline Explorer
Disallow: /

User-agent: Teleport
Disallow: /

User-agent: TeleportPro
Disallow: /

User-agent: WebZIP
Disallow: /

User-agent: linko
Disallow: /

User-agent: HTTrack
Disallow: /

User-agent: Microsoft.URL.Control
Disallow: /

User-agent: Xenu
Disallow: /

User-agent: larbin
Disallow: /

User-agent: libwww
Disallow: /

User-agent: ZyBORG
Disallow: /

User-agent: Download Ninja
Disallow: /

User-agent: wget
Disallow: /

User-agent: grub-client
Disallow: /

User-agent: k2spider
Disallow: /

User-agent: NPBot
Disallow: /

User-agent: WebReaper
Disallow: /

user-agent: *
disallow: /*add-to-cart=*
Sitemap: https://lahora.pe/sitemaps.xml

user-agent: MJ12bot
disallow: /

user-agent: *
disallow: /wp-admin/
allow: /wp-admin/admin-ajax.php

History

Changes recorded since June 2026.

No change recorded.

In context

Peru
10.3% block at least one AI crawler
Behind Cloudflare
Yes