CrawlerPulse
CrawlerPulse / South America / Argentina / periodicotodos.com

Periódico Todos

periodicotodos.com · Argentina · measured 8 Oct 2026

Google Search
Allowed
Google-Extended
Blocked
OpenAI
Blocked
Anthropic
Blocked
Perplexity
Blocked
Meta
Allowed
Common Crawl
Blocked
ByteDance
Blocked
Apple
Blocked
Amazon
Blocked

robots.txt

As read on 8 Oct 2026, 1,473 bytes. 11 rule groups name AI crawlers; shown first.

User-agent: PetalBot
Disallow: /

User-agent: ByteSpider
Disallow: /

User-agent: Google-Extended
Disallow: /

User-agent: GPTBot
Disallow: /

User-agent: ClaudeBot
Disallow: /

User-agent: Claude-Web
Disallow: /

User-agent: CCBot
Disallow: /

User-agent: Amazonbot
Disallow: /

User-agent: FacebookBot
Disallow: /

User-agent: PerplexityBot
Disallow: /

User-agent: Applebot-Extended
Disallow: /

User-agent: Googlebot
Allow: /

User-agent: Googlebot-Image
Allow: /

User-agent: Googlebot-News
Allow: /

User-agent: Googlebot-Video
Allow: /

User-agent: Google-InspectionTool
Allow: /

User-agent: AdsBot-Google
Allow: /

User-agent: GoogleOther
Allow: /

User-agent: Storebot-Google
Allow: /

User-agent: AhrefsBot
Disallow: /

User-agent: AhrefsSiteAudit
Disallow: /

User-agent: SemrushBot
Disallow: /

User-agent: SiteAuditBot
Disallow: /

User-agent: BLEXBot
Disallow: /

User-agent: MJ12bot
Disallow: /

User-agent: DotBot
Disallow: /

User-agent: DataForSeoBot
Disallow: /

User-agent: MajesticBot
Disallow: /

User-agent: Barkrowler
Disallow: /

User-agent: BrandVerity
Disallow: /

User-agent: ScreamingFrog
Disallow: /

User-agent: SEOkicks
Disallow: /

User-agent: serpstatbot
Disallow: /

User-agent: SISTRIX
Disallow: /

User-agent: linkdexbot
Disallow: /

User-agent: Rogerbot
Disallow: /

User-agent: ZoominfoBot
Disallow: /

User-agent: MegaIndex
Disallow: /

User-agent: YandexBot
Disallow: /

User-agent: Baiduspider
Disallow: /

User-agent: *
Allow: /

History

Changes recorded since June 2026.

No change recorded.

In context

Argentina
5.9% block at least one AI crawler
Behind Cloudflare
Yes