CrawlerPulse
CrawlerPulse / Asia / Myanmar / burmatoday.net

burmatoday.net

burmatoday.net · Myanmar · measured 8 Oct 2026

Google Search
Allowed
Google-Extended
Allowed
OpenAI
Allowed
Anthropic
Allowed
Perplexity
Allowed
Meta
Allowed
Common Crawl
Allowed
ByteDance
Allowed
Apple
Allowed
Amazon
Allowed

robots.txt

As read on 8 Oct 2026, 626 bytes. No rule names an AI crawler.

<!DOCTYPE html PUBLIC "-//W3C//DTD XHTML 1.0 Transitional//EN"
"http://www.w3.org/TR/xhtml1/DTD/xhtml1-transitional.dtd">
<html lang="en" xml:lang="en" xmlns="http://www.w3.org/1999/xhtml">
 <head>
  <title>
   Error 404 - Not found
  </title>
  <meta content="text/html; charset=utf-8" http-equiv="Content-Type">
  <meta content="no-cache" http-equiv="cache-control">
 </head>
 <body style="font-family:arial;">
  <h1 style="color:#0a328c;font-size:1.0em;">
   Error 404 - Not found
  </h1>
  <p style="font-size:0.8em;">
   Your browser can't find the document corresponding to the URL you typed in.
  </p>
 </body>
</html>

History

Changes recorded since June 2026.

No change recorded.

In context

Myanmar
10.0% block at least one AI crawler
Behind Cloudflare
No