singtao.ca · Canada · measured 9 Oct 2026
As read on 9 Oct 2026, 2,556 bytes. 1 rule group name AI crawlers; shown first.
User-agent: FacebookBot Allow: / Crawl-delay: 2 # General delay for most bots User-agent: * Allow: / Crawl-delay: 60 # General delay for most bots User-agent: Mediapartners-Google Allow: / Crawl-delay: 2 # Faster crawl (2s delay vs. default 60s) User-agent: Googlebot Allow: / Crawl-delay: 2 # General delay for most bots User-agent: Googlebot-news Allow: / Crawl-delay: 2 # General delay for most bots User-agent: facebookexternalhit Allow: / Crawl-delay: 2 # General delay for most bots User-agent: Facebot Allow: / Crawl-delay: 2 # General delay for most bots User-agent: AhrefsBot Allow: / Crawl-delay: 5 User-agent: bingbot User-agent: msnbot User-agent: slurp User-agent: yandex User-agent: baiduspider User-agent: alexabot User-agent: ia_archiver Allow: / Crawl-delay: 300 # slow than default Disallow: /wp-admin/ Disallow: /wp-includes/ Disallow: /wp-content/plugins/ Disallow: /wp-content/upgrade/ Disallow: /wp-content/wflogs/ Disallow: /wp-content/rsspi-log/ Disallow: /wp-content/languages/ Disallow: /dushi/ Disallow: /dushi-single/ Disallow: /deals/blackfriday/ Disallow: /deals/singclub/ Disallow: /readme.html Disallow: /refer/ Disallow: /?s= Disallow: /search/ Disallow: /daily_ Sitemap: https://www.singtao.ca/gen-sitemap/post/today/ Sitemap: https://www.singtao.ca/gen-sitemap/rtnews/today/ Sitemap: https://www.singtao.ca/toronto-weather/sitemap.xml Sitemap: https://www.singtao.ca/vancouver-weather/sitemap.xml Sitemap: https://www.singtao.ca/calgary-weather/sitemap.xml Sitemap: https://www.singtao.ca/currency-exchange/sitemap.xml
Changes recorded since June 2026.
No change recorded.