CrawlerPulse
CrawlerPulse / North America / United States / idahopress.com

Idaho Press

idahopress.com · United States · Adams Publishing Group · measured 8 Oct 2026

Google Search
Allowed
Google-Extended
Allowed
OpenAI
Allowed
Anthropic
Allowed
Perplexity
Allowed
Meta
Allowed
Common Crawl
Allowed
ByteDance
Allowed
Apple
Allowed
Amazon
Allowed

robots.txt

As read on 8 Oct 2026, 2,803 bytes. No rule names an AI crawler.

User-agent: *
Disallow: /tncms/tracking/
Disallow: /_services/
Disallow: /apgstate/
Disallow: /nowapp/delete_account/
Disallow: /test/
Disallow: /z_disabled_2021womenofinfluence/
Disallow: /tncms/auth/
Disallow: /tncms/admin/
Disallow: /tncms/media/
Disallow: /tncms/gtm/
Disallow: /tncms/block/
Disallow: /tncms/dmp/
Disallow: /tncms/counter/
Disallow: /tncms/openweb/*
Disallow: /tncms/weather/
Disallow: /tncms/messaging/
Disallow: /tncms/csrf/
Disallow: /tncms/tax/
Disallow: /tncms/openid2/
Disallow: /tncms/search/
Disallow: /tncms/webservice/
Disallow: /tncms/track/
Disallow: /marketplace/*action=srch
Disallow: /tncms/calendar/
Disallow: /classifieds/*?
Disallow: /tncms/disqus/
Disallow: /content/tncms/
Disallow: /tncms/user/
Disallow: /users/admin/
Disallow: /users/*/?
Disallow: /content/tncms/assets/v3/form/
Disallow: /content/tncms/form/
Sitemap: https://www.idahopress.com/sitemap.xml
Sitemap: https://www.idahopress.com/tncms/sitemap/editorial.xml
Sitemap: https://www.idahopress.com/tncms/sitemap/editorial.xml?year=2002
Sitemap: https://www.idahopress.com/tncms/sitemap/editorial.xml?year=2003
Sitemap: https://www.idahopress.com/tncms/sitemap/editorial.xml?year=2004
Sitemap: https://www.idahopress.com/tncms/sitemap/editorial.xml?year=2005
Sitemap: https://www.idahopress.com/tncms/sitemap/editorial.xml?year=2006
Sitemap: https://www.idahopress.com/tncms/sitemap/editorial.xml?year=2007
Sitemap: https://www.idahopress.com/tncms/sitemap/editorial.xml?year=2008
Sitemap: https://www.idahopress.com/tncms/sitemap/editorial.xml?year=2009
Sitemap: https://www.idahopress.com/tncms/sitemap/editorial.xml?year=2010
Sitemap: https://www.idahopress.com/tncms/sitemap/editorial.xml?year=2011
Sitemap: https://www.idahopress.com/tncms/sitemap/editorial.xml?year=2012
Sitemap: https://www.idahopress.com/tncms/sitemap/editorial.xml?year=2013
Sitemap: https://www.idahopress.com/tncms/sitemap/editorial.xml?year=2014
Sitemap: https://www.idahopress.com/tncms/sitemap/editorial.xml?year=2015
Sitemap: https://www.idahopress.com/tncms/sitemap/editorial.xml?year=2016
Sitemap: https://www.idahopress.com/tncms/sitemap/editorial.xml?year=2017
Sitemap: https://www.idahopress.com/tncms/sitemap/editorial.xml?year=2018
Sitemap: https://www.idahopress.com/tncms/sitemap/editorial.xml?year=2019
Sitemap: https://www.idahopress.com/tncms/sitemap/editorial.xml?year=2020
Sitemap: https://www.idahopress.com/tncms/sitemap/editorial.xml?year=2021
Sitemap: https://www.idahopress.com/tncms/sitemap/editorial.xml?year=2022
Sitemap: https://www.idahopress.com/tncms/sitemap/editorial.xml?year=2023
Sitemap: https://www.idahopress.com/tncms/sitemap/editorial.xml?year=2024
Sitemap: https://www.idahopress.com/tncms/sitemap/editorial.xml?year=2025

History

Changes recorded since June 2026.

2026-10-08Blocked → AllowedGoogle-Extended

In context

United States
63.2% block at least one AI crawler
Behind Cloudflare
No
Same group