Pedestrian.tv

pedestrian.tv · Australia · Nine · measured 8 Oct 2026

Google Search

Allowed

Google-Extended

Allowed

OpenAI

Allowed

Anthropic

Allowed

Perplexity

Allowed

robots.txt

As read on 8 Oct 2026, 155 bytes. No rule names an AI crawler.

User-Agent: *
Allow: /
Disallow: /admin
Disallow: /api
Sitemap: https://www.pedestrian.tv/sitemap.xml
Sitemap: https://www.pedestrian.tv/news-sitemap.xml

History

Changes recorded since June 2026.

2026-09-24Blocked → AllowedGoogle-Extended

In context

Australia

34.0% block at least one AI crawler

Behind Cloudflare

Yes

Same group

2gb.com, 3aw.com.au, 4bc.com.au, 6pr.com.au, 9news.com.au, afr.com, brisbanetimes.com.au, businessinsider.com.au, nine.com.au, smh.com.au, theage.com.au, watoday.com.au