beritaharian.sg · Singapore · measured 8 Oct 2026
As read on 8 Oct 2026, 1,690 bytes. 10 rule groups name AI crawlers; shown first.
User-agent: Google-Extended Disallow: / Allow: /*?*ai-allowed=1 User-agent: Google-CloudVertexBot Allow: / User-agent: ChatGPT-User Allow: / User-agent: GPTBot Allow: / User-agent: OAI-SearchBot Allow: / User-agent: anthropic-ai Allow: / User-agent: ClaudeBot Allow: / User-agent: claude-web Allow: / User-agent: PerplexityBot Allow: / User-agent: DeepseekBot Allow: / User-agent: * Crawl-delay: 10 Disallow: /5908/* Disallow: /embed/* Disallow: /mysph/* Disallow: /ldap/* Disallow: /login_details.php Disallow: /mobile-banners/* Disallow: /feeds/puzzle Disallow: /feeds/moe-caas-json Disallow: /404.html Disallow: /concurrencyCheck.html Sitemap: https://www.beritaharian.sg/googlenews.xml Sitemap: https://www.beritaharian.sg/sitemap.xml User-agent: Google-Read-Aloud Allow: / User-agent: ChatGPT-OpenAI Allow: / User-agent: Claude-SearchBot Allow: / User-agent: Claude-User Allow: / User-agent: Perplexity-User Allow: / User-agent: Bingbot Allow: / User-agent: Deepseek Allow: /
Changes recorded since June 2026.
No change recorded.