CrawlerPulse
CrawlerPulse / North America / United States / krdo.com

KRDO

krdo.com · United States · News-Press & Gazette · measured 8 Oct 2026

Google Search
Partial
Google-Extended
Partial
OpenAI
Partial
Anthropic
Partial
Perplexity
Partial
Meta
Partial
Common Crawl
Partial
ByteDance
Partial
Apple
Partial
Amazon
Partial

robots.txt

As read on 8 Oct 2026, 274 bytes. 1 rule group name AI crawlers; shown first.

User-agent: SEOkicks-Robot
User-agent: MJ12bot
User-agent: PetalBot
Disallow: /

User-agent: *
Disallow: /wp-admin/
Disallow: /search/
Disallow: /page/
Disallow: /category/
Disallow: /wp-content/uploads/wpforms/
Allow: /wp-admin/admin-ajax.php

User-agent: *
Crawl-delay: 25

History

Changes recorded since June 2026.

No change recorded.

In context

United States
63.2% block at least one AI crawler
Behind Cloudflare
No
Same group