CrawlerPulse
CrawlerPulse / Asia / Taiwan / nownews.com

NowNews

nownews.com · Taiwan · NOWnews Network Co.,Ltd. · measured 8 Oct 2026

Google Search
Allowed
Google-Extended
Allowed
OpenAI
Allowed
Anthropic
Allowed
Perplexity
Allowed
Meta
Allowed
Common Crawl
Allowed
ByteDance
Allowed
Apple
Allowed
Amazon
Allowed

robots.txt

As read on 8 Oct 2026, 622 bytes. 1 rule group name AI crawlers; shown first.

User-agent: Google-Extended
User-agent: GoogleOther
User-agent: GoogleOther-Image
User-agent: GoogleOther-Video
User-agent: Meta-ExternalAgent
User-agent: Meta-ExternalFetcher
User-agent: FacebookBot
User-agent: facebookexternalhit
Allow: /

User-agent: *
Disallow: /manifest.json
Disallow: /sinyi*
Disallow: /nestle-survey.html
Disallow: /nn-client/*
Disallow: /post/*
Disallow: /gamapass/*
Sitemap: https://www.nownews.com/sitemap.xml
Sitemap: https://www.nownews.com/newsSitemap-daily.xml
Sitemap: https://www.nownews.com/sitemap-video.xml
Sitemap: https://www.nownews.com/sitemap-reporter.xml

History

Changes recorded since June 2026.

No change recorded.

In context

Taiwan
35.7% block at least one AI crawler
Behind Cloudflare
No