CrawlerPulse
CrawlerPulse / North America / United States / gazettextra.com

Janesville Gazette

gazettextra.com · United States · Adams Publishing Group · measured 8 Oct 2026

Google Search
Allowed
Google-Extended
Allowed
OpenAI
Allowed
Anthropic
Allowed
Perplexity
Allowed
Meta
Allowed
Common Crawl
Allowed
ByteDance
Allowed
Apple
Allowed
Amazon
Allowed

robots.txt

As read on 8 Oct 2026, 3,753 bytes. No rule names an AI crawler.

User-agent: *
Disallow: /tncms/tracking/
Disallow: /_services/
Disallow: /newsletters/business/
Disallow: /rate-change/
Disallow: /site/forms/printrequest/
Disallow: /test/
Disallow: /test_homepage/
Disallow: /tncms/admin/
Disallow: /tncms/dmp/
Disallow: /tncms/openid2/
Disallow: /tncms/counter/
Disallow: /tncms/gtm/
Disallow: /tncms/openweb/*
Disallow: /tncms/track/
Disallow: /tncms/webservice/
Disallow: /tncms/search/
Disallow: /tncms/csrf/
Disallow: /tncms/weather/
Disallow: /tncms/messaging/
Disallow: /tncms/media/
Disallow: /tncms/auth/
Disallow: /tncms/tax/
Disallow: /tncms/block/
Disallow: /content/tncms/assets/v3/form/
Disallow: /content/tncms/form/
Disallow: /content/tncms/
Disallow: /tncms/user/
Disallow: /users/admin/
Disallow: /users/*/?
Disallow: /marketplace/*action=srch
Disallow: /tncms/calendar/
Disallow: /calendar/search/
Disallow: /calendar/advance_registration/search/
Disallow: /calendar/antiques/search/
Disallow: /calendar/auditions/search/
Disallow: /calendar/comedy/search/
Disallow: /calendar/community/search/
Disallow: /calendar/crafts/search/
Disallow: /calendar/dance/search/
Disallow: /calendar/exhibits/search/
Disallow: /calendar/fairs_and_festivals/search/
Disallow: /calendar/faith/search/
Disallow: /calendar/films/search/
Disallow: /calendar/food_and_drink/search/
Disallow: /calendar/gardening/search/
Disallow: /calendar/halloween/search/
Disallow: /calendar/health/search/
Disallow: /calendar/holiday/search/
Disallow: /calendar/kids_stuff/search/
Disallow: /calendar/lectures/search/
Disallow: /calendar/miscellaneous/search/
Disallow: /calendar/music/search/
Disallow: /calendar/recreation/search/
Disallow: /calendar/summer_source/search/
Disallow: /calendar/support_groups/search/
Disallow: /calendar/test/search/
Disallow: /calendar/theater/search/
Disallow: /calendar/writers_and_words/search/
Disallow: /tncms/disqus/
Disallow: /classifieds/*?
Sitemap: https://www.gazettextra.com/sitemap.xml
Sitemap: https://www.gazettextra.com/tncms/sitemap/editorial.xml
Sitemap: https://www.gazettextra.com/tncms/sitemap/editorial.xml?year=1899
Sitemap: https://www.gazettextra.com/tncms/sitemap/editorial.xml?year=1984
Sitemap: https://www.gazettextra.com/tncms/sitemap/editorial.xml?year=2001
Sitemap: https://www.gazettextra.com/tncms/sitemap/editorial.xml?year=2007
Sitemap: https://www.gazettextra.com/tncms/sitemap/editorial.xml?year=2008
Sitemap: https://www.gazettextra.com/tncms/sitemap/editorial.xml?year=2009
Sitemap: https://www.gazettextra.com/tncms/sitemap/editorial.xml?year=2010
Sitemap: https://www.gazettextra.com/tncms/sitemap/editorial.xml?year=2011
Sitemap: https://www.gazettextra.com/tncms/sitemap/editorial.xml?year=2012
Sitemap: https://www.gazettextra.com/tncms/sitemap/editorial.xml?year=2013
Sitemap: https://www.gazettextra.com/tncms/sitemap/editorial.xml?year=2014
Sitemap: https://www.gazettextra.com/tncms/sitemap/editorial.xml?year=2015
Sitemap: https://www.gazettextra.com/tncms/sitemap/editorial.xml?year=2016
Sitemap: https://www.gazettextra.com/tncms/sitemap/editorial.xml?year=2017
Sitemap: https://www.gazettextra.com/tncms/sitemap/editorial.xml?year=2018
Sitemap: https://www.gazettextra.com/tncms/sitemap/editorial.xml?year=2019
Sitemap: https://www.gazettextra.com/tncms/sitemap/editorial.xml?year=2020
Sitemap: https://www.gazettextra.com/tncms/sitemap/editorial.xml?year=2021
Sitemap: https://www.gazettextra.com/tncms/sitemap/editorial.xml?year=2022
Sitemap: https://www.gazettextra.com/tncms/sitemap/editorial.xml?year=2023
Sitemap: https://www.gazettextra.com/tncms/sitemap/editorial.xml?year=2024
Sitemap: https://www.gazettextra.com/tncms/sitemap/editorial.xml?year=2025

History

Changes recorded since June 2026.

2026-10-08Blocked → AllowedGoogle-Extended

In context

United States
63.2% block at least one AI crawler
Behind Cloudflare
No
Same group