CrawlerPulse
CrawlerPulse / North America / United States / wvva.com

WVVA

wvva.com · United States · Gray Media, Inc. · measured 8 Oct 2026

Google Search
Allowed
Google-Extended
Blocked
OpenAI
Blocked
Anthropic
Blocked
Perplexity
Blocked
Meta
Allowed
Common Crawl
Blocked
ByteDance
Blocked
Apple
Allowed
Amazon
Blocked

robots.txt

As read on 8 Oct 2026, 1,189 bytes. 1 rule group name AI crawlers; shown first.

User-agent: GPTBot
User-agent: ChatGPT-User
User-agent: Google-Extended
User-agent: CCBot
User-agent: Amazonbot
User-agent: anthropic-ai
User-agent: Bytespider
User-agent: ClaudeBot
User-agent: Claude-Web
User-agent: FacebookBot
User-agent: omgili
User-agent: omgilibot
User-agent: PerplexityBot
Disallow: /

Sitemap: https://www.wvva.com/arc/outboundfeeds/sitemap-index/?outputType=xml
Sitemap: https://www.wvva.com/arc/outboundfeeds/news-sitemap-index/category/news/?outputType=xml
Sitemap: https://www.wvva.com/arc/outboundfeeds/video-sitemap/?outputType=xml
Sitemap: https://www.wvva.com/arc/outboundfeeds/sitemap-section-index/?outputType=xml

User-agent: *
Allow: /news/
Allow: /weather/
Allow: /sports/
Disallow: /wires/
Disallow: /wires/press-releases/
Disallow: /wires/bankrate/
Disallow: /video/$
Disallow: /video/shared/
Disallow: /video/vod-recording/
Disallow: /video/livestream/
Disallow: /video/livestream2/
Disallow: /archived/
Disallow: /business/local/
Disallow: /business/page/
Disallow: /news/alert-bar/
Disallow: /news/breaking/
Disallow: /news/top-story/
Disallow: /news/app-extra/
Disallow: /mobi/
Disallow: /clip/
Disallow: /*?outputType=apps
Disallow: /sponsored/$

History

Changes recorded since June 2026.

No change recorded.

In context