CrawlerPulse
CrawlerPulse / North America / Canada / cbc.ca

CBC

cbc.ca · Canada · CBC/Radio-Canada · measured 8 Oct 2026

Google Search
Allowed
Google-Extended
Allowed
OpenAI
Blocked
Anthropic
Allowed
Perplexity
Blocked
Meta
Allowed
Common Crawl
Blocked
ByteDance
Allowed
Apple
Allowed
Amazon
Allowed

robots.txt

As read on 8 Oct 2026, 2,195 bytes. 9 rule groups name AI crawlers; shown first.

User-agent: GPTBot
Disallow: /

User-agent: ChatGPT-User
Disallow: /

User-agent: OAI-SearchBot
Disallow: /

User-Agent: PerplexityBot
Disallow: /

User-agent: CCBot
Disallow: /

User-agent: Anthropic-ai
Disallow: /

User-agent: cohere-ai
Disallow: /

User-agent: DeepSeekBot
Disallow: /

User-agent: Claude-Web
Disallow: /

User-agent: *
Disallow:   /*index.html$
Disallow:   /sports/includes/
Disallow:   /sports/hockey/includes/
Disallow:   /sports/baseball/includes/
Disallow:   /sports/basketball/includes/
Disallow:   /sports/cfl/includes/
Disallow:   /sports/nfl/includes/
Disallow:   /sports/whatson/
Disallow:   /sports/cfl/whatson/
Disallow:   /sports/cfl/cfl-on-cbc/includes/
Disallow:   /sports/hockey/whatson/
Disallow:   /sports/hockey/fantasypool/
Disallow:   /sports/hockey/hnic/includes/
Disallow:   /sports/hockey/hnic/bios/
Disallow:   /cp/
Disallow:   /m/rich/
Disallow:   /search/
Disallow:   /photogallery/*.xml$
Disallow:   /cgi-bin/
Disallow:   /money/stockChart.jsp
Disallow:   /money/stockQuoteChart.jsp
Disallow:   /money/stockQuote.jsp
Disallow:   /index.new.html
Disallow:   /podcasting/includes/tsoas.xml
Disallow:   /podcasting/includes/theheart.xml
Disallow:   /podcasting/includes/bloodlines.xml
Disallow:   /podcasting/includes/resistance.xml
Disallow:   /podcasting/includes/levillage.xml
Disallow:   /podcasting/includes/histoirecrochie.xml
Disallow:   /podcasting/includes/brainwash.xml
Disallow:   /podcasting/includes/hollywoodexiles.xml
Disallow:   /podcasting/includes/avril.xml
Disallow:   /podcasting/includes/goldscam.xml
Disallow:   /podcasting/includes/benevaasktheexperts.xml
Disallow:   /podcasting/includes/wbtc.xml
Disallow:   /dc/

User-agent: Bingbot
Allow: /doncherry/

User-agent: Googlebot-News
Disallow: /radio/thisisthat/
Disallow: /comedy/
Disallow: /radio/becausenews/
Disallow: /radio/podcasts/comedy/
Disallow: /radio/thedebaters/
Disallow: /radio/irrelevantshow/
Disallow: /radio/laughoutloud/
Disallow: /kimsconvenience/
Disallow: /22minutes/
Disallow: /workinmoms/
Disallow: /schittscreek/
Disallow: /mrd/
Disallow: /baroness/
Disallow: /fourinthemorning/
Disallow: /mercerreport/

User-Agent: DeepSeek
Disallow: /

History

Changes recorded since June 2026.

No change recorded.

In context

Canada
45.2% block at least one AI crawler
Behind Cloudflare
No
Same group