malaysia-today.net · Malaysia · measured 8 Oct 2026
As read on 8 Oct 2026, 1,017 bytes. No rule names an AI crawler.
User-agent: * Disallow: /wp-admin/ Allow: /wp-admin/admin-ajax.php Disallow: /wp-includes/ Disallow: /low-bandwidth/ Disallow: /component/ Disallow: /mtcolumns/ Disallow: /rss/feed/ Disallow: /2008/ Disallow: /page/ Disallow: /author/ Disallow: /tag/ User-agent: NinjaBot Allow: / User-agent: GoogleBot Allow: / User-agent: GoogleBot-Mobile Allow: / User-agent: GoogleBot-Image Allow: / User-agent: Mediapartners-Google Allow: / User-agent: Adsbot-Google Allow: / User-agent: Bingbot Allow: / User-agent: Slurp Allow: / User-agent: Teoma Allow: / User-agent: Gigabot Allow: / User-agent: Scrubby Allow: / User-agent: Robozilla Allow: / User-agent: ia_archiver Allow: / User-agent: baiduspider Allow: / User-agent: yahoo-mmcrawler Allow: / User-agent: yeti Allow: / User-agent: naverbot Allow: / User-agent: psbot Allow: / User-agent: Twitterbot Allow: / Sitemap: https://www.malaysia-today.net/sitemap.xml Sitemap: https://www.malaysia-today.net/sitemap.xml.gz
Changes recorded since June 2026.
No change recorded.