CrawlerPulse
CrawlerPulse / Asia / Malaysia / guangming.com.my

Guangming

guangming.com.my · Malaysia · Media Chinese International · measured 8 Oct 2026

Google Search
Allowed
Google-Extended
Allowed
OpenAI
Allowed
Anthropic
Allowed
Perplexity
Allowed
Meta
Allowed
Common Crawl
Allowed
ByteDance
Allowed
Apple
Allowed
Amazon
Allowed

robots.txt

As read on 8 Oct 2026, 1,662 bytes. 1 rule group name AI crawlers; shown first.

User-agent: PetalBot
Allow: /

User-agent: *
Disallow: /wp-admin/
Disallow: /myredirect.php?title=*
Disallow: /topic/facebook-instant-articles*
Disallow: /e-invoice*
Allow: /wp-admin/admin-ajax.php

User-agent: Mediapartners-Google
Allow: /

User-agent: popIn_Agent
Allow: /

User-agent: Mozilla/5.0
Allow: /

User-agent: AhrefsBot/6.1
Disallow: /

User-agent: MegaIndex.ru
Disallow: /

User-agent: MegaIndex.ru/2.0
Disallow: /

User-agent: Cutbot;+1.5
Disallow: /

User-agent: Cutbot/1.5
Disallow: /

User-agent: Cutbot/+1.5
Disallow: /

User-agent: Slurp
Disallow: /

User-agent: Yahoo! Slurp
Disallow: /

User-agent: ToutiaoSpider
Disallow: /

User-agent: ToutiaoSpider/1.0
Disallow: /

User-agent: Baiduspider
Disallow: /

User-agent: Baiduspider/2.0
Disallow: /

User-agent: Baiduspider-render
Disallow: /

User-agent: Baiduspider-render/2.0
Disallow: /

User-agent: SemrushBot
Disallow: /

User-agent: SemrushBot/3~bl
Disallow: /

User-agent: YandexBot
Disallow: /

User-agent: YandexBot/3.0
Disallow: /

User-agent: YandexImages
Disallow: /

User-agent: YandexImages/3.0
Disallow: /

User-agent: PaperLiBot
Disallow: /

User-agent: PaperLiBot/2.1
Disallow: /

User-agent: Clickagy Intelligence Bot v2
Disallow: /

User-agent: sogou spider
Disallow: /

User-agent: Sogou web spider/4.0
Disallow: /

User-agent: Cliqzbot
Disallow: /

User-agent: Cliqzbot/2.0
Disallow: /

User-agent: VoluumDSP-content-bot/2.0
Disallow: /

User-agent: DotBot/1.1
Disallow: /

User-agent: AhrefsBot/5.2
Disallow: /

User-agent: AhrefsBot/6.1
Disallow: /

User-agent: Freshbot/4.0
Disallow: /

User-agent: grapeshot
Disallow:
Sitemap: https://guangming.com.my/sitemap.xml

History

Changes recorded since June 2026.

No change recorded.

In context

Malaysia
16.7% block at least one AI crawler
Behind Cloudflare
Yes
Same group
chinapress.com.my, enanyang.my, mysinchew.sinchew.com.my, sinchew.com.my