fredericknewspost.com · United States · measured 9 Oct 2026
As read on 9 Oct 2026, 7,507 bytes. 21 rule groups name AI crawlers; shown first.
User-agent: Applebot-Extended Disallow: / User-agent: Bytespider Disallow: / User-agent: CCBot Disallow: / User-agent: ChatGPT-User Disallow: / User-agent: Claude-Web Disallow: / User-agent: ClaudeBot Disallow: / User-agent: Diffbot Disallow: / User-agent: FacebookBot Disallow: / User-agent: GPTBot Disallow: / User-agent: Google-Extended Disallow: / User-agent: ImagesiftBot Disallow: / User-agent: Meta-ExternalAgent Disallow: / User-agent: OAI-SearchBot Disallow: / User-agent: PerplexityBot Disallow: / User-agent: PetalBot Disallow: / User-agent: Timpibot Disallow: / User-agent: YouBot Disallow: / User-agent: anthropic-ai Disallow: / User-agent: cohere-ai Disallow: / User-agent: omgili Disallow: / User-agent: omgilibot Disallow: / User-agent: AI2Bot Disallow: / User-agent: Ai2Bot-Dolma Disallow: / User-agent: FriendlyCrawler Disallow: / User-agent: ICC-Crawler Disallow: / User-agent: Scrapy Disallow: / User-agent: VelenPublicWebCrawler Disallow: / User-agent: Webzio-Extended Disallow: / User-agent: iaskspider/2.0 Disallow: / User-agent: img2dataset Disallow: / User-agent: * Disallow: /tncms/tracking/ Disallow: /_services/ Disallow: /goto/ Disallow: /special/athlete_of_the_month/ Disallow: /test/ Disallow: /test/2023redo_front1/ Disallow: /test/2023redo_front1/news-test/ Disallow: /test/72/ Disallow: /test/baseboard/ Disallow: /test/bob_test/ Disallow: /test/classifieds/ Disallow: /test/f2f/ Disallow: /test/fpbigmast1/ Disallow: /test/fpbigmast2/ Disallow: /test/fptest/ Disallow: /test/games/ Disallow: /test/gtest/ Disallow: /test/holidays2017/ Disallow: /test/homefinder/ Disallow: /test/men/ Disallow: /test/meter/ Disallow: /test/nxt/ Disallow: /test/revtest/ Disallow: /test/revtest1028/ Disallow: /test/revtest1031/ Disallow: /test/revtest112/ Disallow: /test/revtest113/ Disallow: /test/revtest114/ Disallow: /test/survey/ Disallow: /test/testvet/ Disallow: /test/tntest/ Disallow: /tncms/gtm/ Disallow: /tncms/csrf/ Disallow: /tncms/openweb/* Disallow: /tncms/search/ Disallow: /tncms/tax/ Disallow: /tncms/admin/ Disallow: /tncms/openid2/ Disallow: /tncms/media/ Disallow: /tncms/messaging/ Disallow: /tncms/counter/ Disallow: /tncms/weather/ Disallow: /tncms/track/ Disallow: /tncms/webservice/ Disallow: /tncms/block/ Disallow: /tncms/auth/ Disallow: /tncms/dmp/ Disallow: /newsletter/optimize Disallow: /newsletter/optimize/advertisement Disallow: /newsletter/optimize/breaking Disallow: /newsletter/optimize/calendar Disallow: /newsletter/optimize/daily_headlines Disallow: /newsletter/optimize/obituaries Disallow: /newsletter/optimize/sports Disallow: /newsletter/optimize/weather Disallow: /newsletter/optimize/weekly_best_of Disallow: /newsletter/optimize/on_the_town Disallow: /newsletter/optimize/eat_and_drink Disallow: /newsletter/optimize/health_and_wellness Disallow: /newsletter/optimize/family_fun Disallow: /newsletter/optimize/epages Disallow: /newsletter/optimize/classifieds Disallow: /newsletter/optimize/high_school_sports Disallow: /newsletter/optimize/middletown_and_braddock_heights Disallow: /content/tncms/ Disallow: /test/classifieds/*? Disallow: /classifieds_tn/*? Disallow: /classifieds_tn/local_mentions/*? Disallow: /classifieds_tn/vehicles/*? Disallow: /classifieds_tn/real_estate/*? Disallow: /classifieds_tn/services/*? Disallow: /classifieds_tn/yard_sales/*? Disallow: /content/tncms/assets/v3/form/ Disallow: /content/tncms/form/ Disallow: /marketplace/*action=srch Disallow: /tncms/user/ Disallow: /users/admin/ Disallow: /users/*/? Disallow: /tncms/calendar/ Disallow: /calendar/search/ Disallow: /calendar/classes_workshops_and_lectures/search/ Disallow: /calendar/community_and_festivals/search/ Disallow: /calendar/family/search/ Disallow: /calendar/film/search/ Disallow: /calendar/government_and_politics/search/ Disallow: /calendar/health/search/ Disallow: /calendar/nightlife/search/ Disallow: /calendar/other/search/ Disallow: /calendar/outdoors/search/ Disallow: /calendar/performer/search/ Disallow: /calendar/performing_arts_and_music/search/ Disallow: /calendar/religious_and_spiritual/search/ Disallow: /calendar/sports_and_recreation/search/ Disallow: /calendar/theater/search/ Disallow: /calendar/visual_arts/search/ Disallow: /z/print_calendar/search/ Disallow: /z/print_calendar/72_hours_main/search/ Disallow: /z/print_calendar/72_hours_nightlife/search/ Disallow: /z/print_calendar/72_hours_ongoing/search/ Disallow: /z/print_calendar/bulletin_board/search/ Disallow: /z/print_calendar/health/search/ Disallow: /z/print_calendar/real_frederick/search/ Disallow: /z/print_calendar/senior_calendar/search/ Disallow: /z/print_calendar/dailynewsletter/search/ Disallow: /z/print_calendar/daily_calendar/search/ Disallow: /z/print_calendar/ag-calendar/search/ Disallow: /tncms/disqus/ Sitemap: https://www.fredericknewspost.com/sitemap.xml Sitemap: https://www.fredericknewspost.com/tncms/sitemap/editorial.xml Sitemap: https://www.fredericknewspost.com/tncms/sitemap/editorial.xml?year=1997 Sitemap: https://www.fredericknewspost.com/tncms/sitemap/editorial.xml?year=1998 Sitemap: https://www.fredericknewspost.com/tncms/sitemap/editorial.xml?year=1999 Sitemap: https://www.fredericknewspost.com/tncms/sitemap/editorial.xml?year=2000 Sitemap: https://www.fredericknewspost.com/tncms/sitemap/editorial.xml?year=2001 Sitemap: https://www.fredericknewspost.com/tncms/sitemap/editorial.xml?year=2002 Sitemap: https://www.fredericknewspost.com/tncms/sitemap/editorial.xml?year=2003 Sitemap: https://www.fredericknewspost.com/tncms/sitemap/editorial.xml?year=2004 Sitemap: https://www.fredericknewspost.com/tncms/sitemap/editorial.xml?year=2005 Sitemap: https://www.fredericknewspost.com/tncms/sitemap/editorial.xml?year=2006 Sitemap: https://www.fredericknewspost.com/tncms/sitemap/editorial.xml?year=2007 Sitemap: https://www.fredericknewspost.com/tncms/sitemap/editorial.xml?year=2008 Sitemap: https://www.fredericknewspost.com/tncms/sitemap/editorial.xml?year=2009 Sitemap: https://www.fredericknewspost.com/tncms/sitemap/editorial.xml?year=2010 Sitemap: https://www.fredericknewspost.com/tncms/sitemap/editorial.xml?year=2011 Sitemap: https://www.fredericknewspost.com/tncms/sitemap/editorial.xml?year=2012 Sitemap: https://www.fredericknewspost.com/tncms/sitemap/editorial.xml?year=2013 Sitemap: https://www.fredericknewspost.com/tncms/sitemap/editorial.xml?year=2014 Sitemap: https://www.fredericknewspost.com/tncms/sitemap/editorial.xml?year=2015 Sitemap: https://www.fredericknewspost.com/tncms/sitemap/editorial.xml?year=2016 Sitemap: https://www.fredericknewspost.com/tncms/sitemap/editorial.xml?year=2017 Sitemap: https://www.fredericknewspost.com/tncms/sitemap/editorial.xml?year=2018 Sitemap: https://www.fredericknewspost.com/tncms/sitemap/editorial.xml?year=2019 Sitemap: https://www.fredericknewspost.com/tncms/sitemap/editorial.xml?year=2020 Sitemap: https://www.fredericknewspost.com/tncms/sitemap/editorial.xml?year=2021 Sitemap: https://www.fredericknewspost.com/tncms/sitemap/editorial.xml?year=2022 Sitemap: https://www.fredericknewspost.com/tncms/sitemap/editorial.xml?year=2023 Sitemap: https://www.fredericknewspost.com/tncms/sitemap/editorial.xml?year=2024 Sitemap: https://www.fredericknewspost.com/tncms/sitemap/editorial.xml?year=2025
Changes recorded since June 2026.
No change recorded.