CrawlerPulse
CrawlerPulse / North America / United States / buffalonews.com

Buffalo News

buffalonews.com · United States · Lee Enterprises Inc · measured 8 Oct 2026

Google Search
Allowed
Google-Extended
Blocked
OpenAI
Blocked
Anthropic
Blocked
Perplexity
Blocked
Meta
Blocked
Common Crawl
Blocked
ByteDance
Blocked
Apple
Blocked
Amazon
Allowed

robots.txt

As read on 8 Oct 2026, 8,129 bytes. 21 rule groups name AI crawlers; shown first.

User-agent: Applebot-Extended
Disallow: /

User-agent: Bytespider
Disallow: /

User-agent: CCBot
Disallow: /

User-agent: ChatGPT-User
Disallow: /

User-agent: Claude-Web
Disallow: /

User-agent: ClaudeBot
Disallow: /

User-agent: Diffbot
Disallow: /

User-agent: FacebookBot
Disallow: /

User-agent: GPTBot
Disallow: /

User-agent: Google-Extended
Disallow: /

User-agent: ImagesiftBot
Disallow: /

User-agent: Meta-ExternalAgent
Disallow: /

User-agent: OAI-SearchBot
Disallow: /

User-agent: PerplexityBot
Disallow: /

User-agent: PetalBot
Disallow: /

User-agent: Timpibot
Disallow: /

User-agent: YouBot
Disallow: /

User-agent: anthropic-ai
Disallow: /

User-agent: cohere-ai
Disallow: /

User-agent: omgili
Disallow: /

User-agent: omgilibot
Disallow: /

User-agent: AI2Bot
Disallow: /

User-agent: Ai2Bot-Dolma
Disallow: /

User-agent: FriendlyCrawler
Disallow: /

User-agent: ICC-Crawler
Disallow: /

User-agent: Scrapy
Disallow: /

User-agent: VelenPublicWebCrawler
Disallow: /

User-agent: Webzio-Extended
Disallow: /

User-agent: iaskspider/2.0
Disallow: /

User-agent: img2dataset
Disallow: /

User-agent: *
Disallow: /tncms/tracking/
Disallow: /_services/
Disallow: /exclusive/get-healthy/
Disallow: /exclusive/subscription/
Disallow: /nowapp/delete_account/
Disallow: /obituaries/memoriam/
Disallow: /obituaries/notices/
Disallow: /pending/
Disallow: /test/
Disallow: /test/podcast/
Disallow: /test/privacy/
Disallow: /test/terms/
Disallow: /uploaded_photos/
Disallow: /users/relogin/
Disallow: /tncms/gtm/
Disallow: /tncms/dmp/
Disallow: /tncms/messaging/
Disallow: /tncms/tax/
Disallow: /tncms/openid2/
Disallow: /tncms/weather/
Disallow: /tncms/csrf/
Disallow: /tncms/track/
Disallow: /tncms/media/
Disallow: /tncms/webservice/
Disallow: /tncms/search/
Disallow: /tncms/counter/
Disallow: /tncms/openweb/*
Disallow: /tncms/auth/
Disallow: /tncms/block/
Disallow: /tncms/admin/
Disallow: /tncms/user/
Disallow: /users/admin/
Disallow: /users/*/?
Disallow: /content/tncms/assets/v3/form/
Disallow: /content/tncms/form/
Disallow: /advertise/examples/admail
Disallow: /newsletter-templates
Disallow: /newsletter-templates/archives
Disallow: /newsletter-templates/business
Disallow: /newsletter-templates/crime
Disallow: /newsletter-templates/daily-headlines
Disallow: /newsletter-templates/education
Disallow: /newsletter-templates/eedition
Disallow: /newsletter-templates/entertainment
Disallow: /newsletter-templates/food-and-drink
Disallow: /newsletter-templates/health
Disallow: /newsletter-templates/home-and-garden
Disallow: /newsletter-templates/hot
Disallow: /newsletter-templates/local
Disallow: /newsletter-templates/local/bills
Disallow: /newsletter-templates/local/business
Disallow: /newsletter-templates/local/child-victims-act
Disallow: /newsletter-templates/local/covid
Disallow: /newsletter-templates/local/food-and-drink
Disallow: /newsletter-templates/local/good-morning
Disallow: /newsletter-templates/local/hamburg
Disallow: /newsletter-templates/local/nursing-homes
Disallow: /newsletter-templates/local/orchard-park
Disallow: /newsletter-templates/local/photography
Disallow: /newsletter-templates/local/sabres
Disallow: /newsletter-templates/local/thingstodo
Disallow: /newsletter-templates/local/twin-cities
Disallow: /newsletter-templates/local/west-seneca
Disallow: /newsletter-templates/obituaries
Disallow: /newsletter-templates/opinion
Disallow: /newsletter-templates/parenting
Disallow: /newsletter-templates/pets
Disallow: /newsletter-templates/politics
Disallow: /newsletter-templates/preps
Disallow: /newsletter-templates/television
Disallow: /newsletter-templates/topic
Disallow: /newsletter-templates/topic/popup
Disallow: /newsletter-templates/topic/popup2
Disallow: /newsletter-templates/travel
Disallow: /newsletter-templates/weather
Disallow: /newsletter-templates/weather-weekly
Disallow: /newsletter-templates/local/politics
Disallow: /newsletter-templates/afternoon-headlines
Disallow: /newsletter-templates/marketing
Disallow: /newsletter-templates/marketing/get-healthy
Disallow: /newsletter-templates/marketing/advertising-solutions
Disallow: /newsletter-templates/puzzles
Disallow: /newsletter-templates/marketing/affiliate
Disallow: /newsletter-templates/marketing/affiliate/test
Disallow: /newsletter-templates/marketing/suboffer_witharticles
Disallow: /newsletter-templates/weekly-best-of
Disallow: /newsletter-templates/watchdog
Disallow: /newsletter-templates/eedition-afternoon
Disallow: /newsletter-templates/paid
Disallow: /newsletter-templates/paid/editors-pick
Disallow: /newsletter-templates/paid/rewind
Disallow: /newsletter-templates/paid/short-list
Disallow: /newsletter-templates/paid/bright-side
Disallow: /content/tncms/
Disallow: /tncms/disqus/
Disallow: /ads/*?
Disallow: /ads/housing/*?
Disallow: /classifieds/*?
Disallow: /ads/print_ads/*?
Disallow: /ads/vehicle/*?
Disallow: /places/*action=srch
Disallow: /places/dealers/*action=srch
Disallow: /tncms/calendar/
Sitemap: https://buffalonews.com/sitemap.xml
Sitemap: https://buffalonews.com/tncms/sitemap/editorial.xml
Sitemap: https://buffalonews.com/tncms/sitemap/editorial.xml?year=1970
Sitemap: https://buffalonews.com/tncms/sitemap/editorial.xml?year=1987
Sitemap: https://buffalonews.com/tncms/sitemap/editorial.xml?year=1988
Sitemap: https://buffalonews.com/tncms/sitemap/editorial.xml?year=1989
Sitemap: https://buffalonews.com/tncms/sitemap/editorial.xml?year=1990
Sitemap: https://buffalonews.com/tncms/sitemap/editorial.xml?year=1991
Sitemap: https://buffalonews.com/tncms/sitemap/editorial.xml?year=1992
Sitemap: https://buffalonews.com/tncms/sitemap/editorial.xml?year=1993
Sitemap: https://buffalonews.com/tncms/sitemap/editorial.xml?year=1994
Sitemap: https://buffalonews.com/tncms/sitemap/editorial.xml?year=1995
Sitemap: https://buffalonews.com/tncms/sitemap/editorial.xml?year=1996
Sitemap: https://buffalonews.com/tncms/sitemap/editorial.xml?year=1997
Sitemap: https://buffalonews.com/tncms/sitemap/editorial.xml?year=1998
Sitemap: https://buffalonews.com/tncms/sitemap/editorial.xml?year=1999
Sitemap: https://buffalonews.com/tncms/sitemap/editorial.xml?year=2000
Sitemap: https://buffalonews.com/tncms/sitemap/editorial.xml?year=2001
Sitemap: https://buffalonews.com/tncms/sitemap/editorial.xml?year=2002
Sitemap: https://buffalonews.com/tncms/sitemap/editorial.xml?year=2003
Sitemap: https://buffalonews.com/tncms/sitemap/editorial.xml?year=2004
Sitemap: https://buffalonews.com/tncms/sitemap/editorial.xml?year=2005
Sitemap: https://buffalonews.com/tncms/sitemap/editorial.xml?year=2006
Sitemap: https://buffalonews.com/tncms/sitemap/editorial.xml?year=2007
Sitemap: https://buffalonews.com/tncms/sitemap/editorial.xml?year=2008
Sitemap: https://buffalonews.com/tncms/sitemap/editorial.xml?year=2009
Sitemap: https://buffalonews.com/tncms/sitemap/editorial.xml?year=2010
Sitemap: https://buffalonews.com/tncms/sitemap/editorial.xml?year=2011
Sitemap: https://buffalonews.com/tncms/sitemap/editorial.xml?year=2012
Sitemap: https://buffalonews.com/tncms/sitemap/editorial.xml?year=2013
Sitemap: https://buffalonews.com/tncms/sitemap/editorial.xml?year=2014
Sitemap: https://buffalonews.com/tncms/sitemap/editorial.xml?year=2015
Sitemap: https://buffalonews.com/tncms/sitemap/editorial.xml?year=2016
Sitemap: https://buffalonews.com/tncms/sitemap/editorial.xml?year=2017
Sitemap: https://buffalonews.com/tncms/sitemap/editorial.xml?year=2018
Sitemap: https://buffalonews.com/tncms/sitemap/editorial.xml?year=2019
Sitemap: https://buffalonews.com/tncms/sitemap/editorial.xml?year=2020
Sitemap: https://buffalonews.com/tncms/sitemap/editorial.xml?year=2021
Sitemap: https://buffalonews.com/tncms/sitemap/editorial.xml?year=2022
Sitemap: https://buffalonews.com/tncms/sitemap/editorial.xml?year=2023
Sitemap: https://buffalonews.com/tncms/sitemap/editorial.xml?year=2024
Sitemap: https://buffalonews.com/tncms/sitemap/editorial.xml?year=2025

History

Changes recorded since June 2026.

2026-09-22Allowed → BlockedGoogle-Extended

In context