CrawlerPulse
CrawlerPulse / North America / United States / leadertelegram.com

Leader-Telegram

leadertelegram.com · United States · Adams Publishing Group · measured 8 Oct 2026

Google Search
Allowed
Google-Extended
Allowed
OpenAI
Allowed
Anthropic
Allowed
Perplexity
Allowed
Meta
Allowed
Common Crawl
Allowed
ByteDance
Allowed
Apple
Allowed
Amazon
Allowed

robots.txt

As read on 8 Oct 2026, 2,707 bytes. No rule names an AI crawler.

User-agent: *
Disallow: /tncms/tracking/
Disallow: /_services/
Disallow: /subscribe/develop/
Disallow: /test/
Disallow: /tncms/messaging/
Disallow: /tncms/tax/
Disallow: /tncms/block/
Disallow: /tncms/weather/
Disallow: /tncms/openid2/
Disallow: /tncms/search/
Disallow: /tncms/track/
Disallow: /tncms/auth/
Disallow: /tncms/admin/
Disallow: /tncms/csrf/
Disallow: /tncms/counter/
Disallow: /tncms/webservice/
Disallow: /tncms/gtm/
Disallow: /tncms/openweb/*
Disallow: /tncms/dmp/
Disallow: /tncms/media/
Disallow: /marketplace/*action=srch
Disallow: /content/tncms/assets/v3/form/
Disallow: /content/tncms/form/
Disallow: /tncms/calendar/
Disallow: /calendar/search/
Disallow: /calendar/community/search/
Disallow: /calendar/entertainment/search/
Disallow: /calendar/sports/search/
Disallow: /tncms/user/
Disallow: /users/admin/
Disallow: /users/*/?
Disallow: /content/tncms/
Disallow: /classifieds/*?
Disallow: /classifieds/community/*?
Disallow: /classifieds/housing/*?
Disallow: /classifieds/job/*?
Disallow: /classifieds/personals/*?
Disallow: /classifieds/sale/*?
Disallow: /classifieds/service/*?
Disallow: /classifieds/vehicle/*?
Disallow: /classifieds/placead/*?
Disallow: /tncms/disqus/
Sitemap: https://www.leadertelegram.com/sitemap.xml
Sitemap: https://www.leadertelegram.com/tncms/sitemap/editorial.xml
Sitemap: https://www.leadertelegram.com/tncms/sitemap/editorial.xml?year=2009
Sitemap: https://www.leadertelegram.com/tncms/sitemap/editorial.xml?year=2010
Sitemap: https://www.leadertelegram.com/tncms/sitemap/editorial.xml?year=2011
Sitemap: https://www.leadertelegram.com/tncms/sitemap/editorial.xml?year=2012
Sitemap: https://www.leadertelegram.com/tncms/sitemap/editorial.xml?year=2013
Sitemap: https://www.leadertelegram.com/tncms/sitemap/editorial.xml?year=2014
Sitemap: https://www.leadertelegram.com/tncms/sitemap/editorial.xml?year=2015
Sitemap: https://www.leadertelegram.com/tncms/sitemap/editorial.xml?year=2016
Sitemap: https://www.leadertelegram.com/tncms/sitemap/editorial.xml?year=2017
Sitemap: https://www.leadertelegram.com/tncms/sitemap/editorial.xml?year=2018
Sitemap: https://www.leadertelegram.com/tncms/sitemap/editorial.xml?year=2019
Sitemap: https://www.leadertelegram.com/tncms/sitemap/editorial.xml?year=2020
Sitemap: https://www.leadertelegram.com/tncms/sitemap/editorial.xml?year=2021
Sitemap: https://www.leadertelegram.com/tncms/sitemap/editorial.xml?year=2022
Sitemap: https://www.leadertelegram.com/tncms/sitemap/editorial.xml?year=2023
Sitemap: https://www.leadertelegram.com/tncms/sitemap/editorial.xml?year=2024
Sitemap: https://www.leadertelegram.com/tncms/sitemap/editorial.xml?year=2025

History

Changes recorded since June 2026.

2026-10-08Blocked → AllowedGoogle-Extended

In context

United States
63.2% block at least one AI crawler
Behind Cloudflare
No
Same group