CrawlerPulse
CrawlerPulse / North America / Canada / vancouverisland.ctvnews.ca

CTV News Vancouver Island

vancouverisland.ctvnews.ca · Canada · Bell Media · measured 8 Oct 2026

Google Search
Allowed
Google-Extended
Allowed
OpenAI
Blocked
Anthropic
Allowed
Perplexity
Blocked
Meta
Allowed
Common Crawl
Blocked
ByteDance
Allowed
Apple
Allowed
Amazon
Allowed

robots.txt

As read on 8 Oct 2026, 1,634 bytes. 8 rule groups name AI crawlers; shown first.

User-agent: GPTBot
Disallow: /

User-agent: ChatGPT-User
Disallow: /

User-agent: OAI-SearchBot
Disallow: /

User-Agent: PerplexityBot
Disallow: /

User-agent: CCBot
Disallow: /

User-agent: Anthropic-ai
Disallow: /

User-agent: DeepSeekBot
Disallow: /

User-agent: Claude-Web
Disallow: /

Sitemap: https://www.ctvnews.ca/arc/outboundfeeds/sitemap-index/
Sitemap: https://www.ctvnews.ca/arc/outboundfeeds/sitemap-news-index/
Sitemap: https://www.ctvnews.ca/arc/outboundfeeds/sitemap-video-index/

User-agent: *
Allow: /
Disallow: /404/test
Disallow: /captcha/
Disallow: /cmlink/
Disallow: /cm/
Disallow: /error/
Disallow: /rss/
Disallow: /redirect/
Disallow: /status/
Disallow: /errors/
Disallow: /*&cache=*
Disallow: /*?cache=*
Disallow: /mobile/
Disallow: /*-1.*
Disallow: /content/
Disallow: /*.app$
Disallow: /polopoly_fs/
Disallow: /hot-topics/
Disallow: /1.*
Disallow: /*-7.*
Disallow: /CTVNews/T/
Disallow: /TopStories/20091117/
Disallow: /CTVNews/World/20120202/
Disallow: /kitchener/article/reduced-charge-allows-reporter-tieja-maclaughlin-to-return-to-canada/
Disallow: /kitchener/article/tieja-maclaughlin-pleads-not-guilty-to-harassment-in-us-court/
Disallow: /kitchener/article/former-kitchener-woman-accused-of-threatening-to-kill-hockey-player-boyfriend/
Disallow: /kitchener/article/charges-laid-against-reporter-accused-of-threatening-to-kill-boyfriend/
Disallow: /kitchener/article/brantford-councillors-consider-memorial-for-people-lost-to-overdoses/

User-agent: Googlebot-Image
Allow: /resizer/v2/
Disallow: /polopoly_fs/

User-agent: Twitterbot
Allow: /
Disallow: /polopoly_fs/

User-Agent: DeepSeek
Disallow: /

History

Changes recorded since June 2026.

No change recorded.

In context