CrawlerPulse
CrawlerPulse / North America / United States / atlanticcityweekly.com

Atlantic City Weekly

atlanticcityweekly.com · United States · Lee Enterprises Inc · measured 8 Oct 2026

Google Search
Allowed
Google-Extended
Blocked
OpenAI
Blocked
Anthropic
Blocked
Perplexity
Blocked
Meta
Blocked
Common Crawl
Blocked
ByteDance
Blocked
Apple
Blocked
Amazon
Allowed

robots.txt

As read on 8 Oct 2026, 7,402 bytes. 21 rule groups name AI crawlers; shown first.

User-agent: Applebot-Extended
Disallow: /

User-agent: Bytespider
Disallow: /

User-agent: CCBot
Disallow: /

User-agent: ChatGPT-User
Disallow: /

User-agent: Claude-Web
Disallow: /

User-agent: ClaudeBot
Disallow: /

User-agent: Diffbot
Disallow: /

User-agent: FacebookBot
Disallow: /

User-agent: GPTBot
Disallow: /

User-agent: Google-Extended
Disallow: /

User-agent: ImagesiftBot
Disallow: /

User-agent: Meta-ExternalAgent
Disallow: /

User-agent: OAI-SearchBot
Disallow: /

User-agent: PerplexityBot
Disallow: /

User-agent: PetalBot
Disallow: /

User-agent: Timpibot
Disallow: /

User-agent: YouBot
Disallow: /

User-agent: anthropic-ai
Disallow: /

User-agent: cohere-ai
Disallow: /

User-agent: omgili
Disallow: /

User-agent: omgilibot
Disallow: /

User-agent: AI2Bot
Disallow: /

User-agent: Ai2Bot-Dolma
Disallow: /

User-agent: FriendlyCrawler
Disallow: /

User-agent: ICC-Crawler
Disallow: /

User-agent: Scrapy
Disallow: /

User-agent: VelenPublicWebCrawler
Disallow: /

User-agent: Webzio-Extended
Disallow: /

User-agent: iaskspider/2.0
Disallow: /

User-agent: img2dataset
Disallow: /

User-agent: *
Disallow: /tncms/tracking/
Disallow: /_services/
Disallow: /tncms/csrf/
Disallow: /tncms/gtm/
Disallow: /tncms/tax/
Disallow: /tncms/openid2/
Disallow: /tncms/messaging/
Disallow: /tncms/track/
Disallow: /tncms/admin/
Disallow: /tncms/webservice/
Disallow: /tncms/media/
Disallow: /tncms/weather/
Disallow: /tncms/block/
Disallow: /tncms/counter/
Disallow: /tncms/dmp/
Disallow: /tncms/search/
Disallow: /tncms/openweb/*
Disallow: /tncms/auth/
Disallow: /content/tncms/assets/v3/form/
Disallow: /content/tncms/form/
Disallow: /ads/*?
Disallow: /ads/housing/*?
Disallow: /ads/print_ads/*?
Disallow: /ads/vehicle/*?
Disallow: /classifieds/*?
Disallow: /classifieds/community/*?
Disallow: /classifieds/housing/*?
Disallow: /classifieds/job/*?
Disallow: /classifieds/other/*?
Disallow: /classifieds/other/ads/*?
Disallow: /classifieds/personals/*?
Disallow: /classifieds/sale/*?
Disallow: /classifieds/service/*?
Disallow: /classifieds/vehicle/*?
Disallow: /places/*action=srch
Disallow: /tncms/calendar/
Disallow: /calendar/search/
Disallow: /calendar/after_dark/search/
Disallow: /calendar/arts/search/
Disallow: /calendar/books/search/
Disallow: /calendar/casinos/search/
Disallow: /calendar/casinos/headliners/search/
Disallow: /calendar/casinos/lounge_listings/search/
Disallow: /calendar/casinos/poker_rooms/search/
Disallow: /calendar/cities/search/
Disallow: /calendar/comedy/search/
Disallow: /calendar/community/search/
Disallow: /calendar/conventions_and_expos/search/
Disallow: /calendar/dance/search/
Disallow: /calendar/faith/search/
Disallow: /calendar/festivals/search/
Disallow: /calendar/games/search/
Disallow: /calendar/get-involved/search/
Disallow: /calendar/health-and-fitness/search/
Disallow: /calendar/lectures_and_readings/search/
Disallow: /calendar/museums_and_exhibits/search/
Disallow: /calendar/music/search/
Disallow: /calendar/music/in-the-clubs/search/
Disallow: /calendar/outdoors/search/
Disallow: /calendar/performing_arts/search/
Disallow: /calendar/public-meetings/search/
Disallow: /calendar/special_events/search/
Disallow: /calendar/support-groups/search/
Disallow: /calendar/villages_and_wineries/search/
Disallow: /calendar/closings/search/
Disallow: /newsletter-templates
Disallow: /newsletter-templates/archives
Disallow: /newsletter-templates/breaking
Disallow: /newsletter-templates/business
Disallow: /newsletter-templates/crime
Disallow: /newsletter-templates/daily-headlines
Disallow: /newsletter-templates/eedition
Disallow: /newsletter-templates/entertainment
Disallow: /newsletter-templates/food-and-drink
Disallow: /newsletter-templates/health
Disallow: /newsletter-templates/home-and-garden
Disallow: /newsletter-templates/hot
Disallow: /newsletter-templates/local
Disallow: /newsletter-templates/marketing
Disallow: /newsletter-templates/marketing/ad-email
Disallow: /newsletter-templates/marketing/promo
Disallow: /newsletter-templates/marketing/signup
Disallow: /newsletter-templates/members
Disallow: /newsletter-templates/members/deals
Disallow: /newsletter-templates/members/digital
Disallow: /newsletter-templates/members/digitalplus
Disallow: /newsletter-templates/members/gold
Disallow: /newsletter-templates/members/platinum
Disallow: /newsletter-templates/members/silver
Disallow: /newsletter-templates/mlb
Disallow: /newsletter-templates/news-alert
Disallow: /newsletter-templates/obituaries
Disallow: /newsletter-templates/opinion
Disallow: /newsletter-templates/pets
Disallow: /newsletter-templates/politics
Disallow: /newsletter-templates/preps
Disallow: /newsletter-templates/service-alert
Disallow: /newsletter-templates/television
Disallow: /newsletter-templates/topic
Disallow: /newsletter-templates/topic/popup
Disallow: /newsletter-templates/travel
Disallow: /newsletter-templates/weather
Disallow: /newsletter-templates/weather-alerts
Disallow: /newsletter-templates/weekly-best-of
Disallow: /newsletter-templates/topic/popup2
Disallow: /newsletter-templates/weather-weekly
Disallow: /newsletter-templates/marketing/special
Disallow: /newsletter-templates/marketing/ad-html
Disallow: /newsletter-templates/marketing/b2b
Disallow: /content/tncms/
Disallow: /tncms/disqus/
Disallow: /tncms/user/
Disallow: /users/admin/
Disallow: /users/*/?
Sitemap: https://atlanticcityweekly.com/sitemap.xml
Sitemap: https://atlanticcityweekly.com/tncms/sitemap/editorial.xml
Sitemap: https://atlanticcityweekly.com/tncms/sitemap/editorial.xml?year=1989
Sitemap: https://atlanticcityweekly.com/tncms/sitemap/editorial.xml?year=2004
Sitemap: https://atlanticcityweekly.com/tncms/sitemap/editorial.xml?year=2005
Sitemap: https://atlanticcityweekly.com/tncms/sitemap/editorial.xml?year=2006
Sitemap: https://atlanticcityweekly.com/tncms/sitemap/editorial.xml?year=2007
Sitemap: https://atlanticcityweekly.com/tncms/sitemap/editorial.xml?year=2008
Sitemap: https://atlanticcityweekly.com/tncms/sitemap/editorial.xml?year=2009
Sitemap: https://atlanticcityweekly.com/tncms/sitemap/editorial.xml?year=2010
Sitemap: https://atlanticcityweekly.com/tncms/sitemap/editorial.xml?year=2011
Sitemap: https://atlanticcityweekly.com/tncms/sitemap/editorial.xml?year=2012
Sitemap: https://atlanticcityweekly.com/tncms/sitemap/editorial.xml?year=2013
Sitemap: https://atlanticcityweekly.com/tncms/sitemap/editorial.xml?year=2014
Sitemap: https://atlanticcityweekly.com/tncms/sitemap/editorial.xml?year=2015
Sitemap: https://atlanticcityweekly.com/tncms/sitemap/editorial.xml?year=2016
Sitemap: https://atlanticcityweekly.com/tncms/sitemap/editorial.xml?year=2017
Sitemap: https://atlanticcityweekly.com/tncms/sitemap/editorial.xml?year=2018
Sitemap: https://atlanticcityweekly.com/tncms/sitemap/editorial.xml?year=2019
Sitemap: https://atlanticcityweekly.com/tncms/sitemap/editorial.xml?year=2020
Sitemap: https://atlanticcityweekly.com/tncms/sitemap/editorial.xml?year=2021
Sitemap: https://atlanticcityweekly.com/tncms/sitemap/editorial.xml?year=2022
Sitemap: https://atlanticcityweekly.com/tncms/sitemap/editorial.xml?year=2023
Sitemap: https://atlanticcityweekly.com/tncms/sitemap/editorial.xml?year=2024

History

Changes recorded since June 2026.

No change recorded.

In context