CrawlerPulse
CrawlerPulse / Asia / Japan / nikkan.co.jp

Nikkan Kogyo Shimbun

nikkan.co.jp · Japan · measured 9 Oct 2026

Google Search
Allowed
Google-Extended
Allowed
OpenAI
Allowed
Anthropic
Allowed
Perplexity
Allowed
Meta
Allowed
Common Crawl
Allowed
ByteDance
Allowed
Apple
Allowed
Amazon
Allowed

robots.txt

As read on 9 Oct 2026, 2,123 bytes. No rule names an AI crawler.

<!DOCTYPE html>
<html lang="en">
<head>
    <meta charset="utf-8">
    <meta name="viewport" content="width=device-width, initial-scale=1">
    <title>Human Verification</title>
    <style>
        body {
            font-family: "Arial";
        }
    </style>
    <script type="text/javascript">
    window.awsWafCookieDomainList = [];
    window.gokuProps = {
"key":"AQIDAHjcYu/GjX+QlghicBgQ/7bFaQZ+m5FKCMDnO+vTbNg96AEmTWCSa0wRQ1oM7zYSEl7pAAAAfjB8BgkqhkiG9w0BBwagbzBtAgEAMGgGCSqGSIb3DQEHATAeBglghkgBZQMEAS4wEQQMYo1puAVQV5WAV7KTAgEQgDukhTRjYf0DvwWTrA3w0zCUQ/QciEi/050FcO3AGdAskWTBBIVfmKRA5d5sV5x8Tj6ytauxugbLZPsc9Q==",
          "iv":"A6xnRQA6WgAAAv9Z",
          "context":"L8CdnF+BpKdqQTK69plyG85jdORcXR6dl2j4vL/My1qqMHf6vGfQ2Hg8mexrMoEQO3xk9ukb1CCiAd2AGsYUWYKSfZMqAgHFuN/tBt3xdreNhkW1rHZPqHKSe7iwnYHpEeB+MZQMwXdMW2vZuMlpdxtssrj0By3phZv9ctFHUxum/iJYNtqks8ZhgnwH28uWBD2qrvKcx7JnFyiY5sA7FW896sYoiG0Iyxw/Nfbq7osa/HBXkKyzCt3V0o1ZVueIHBuQdntNxNmUY9jr8iaMa/7h7024v2KPzpkYw/QGMQvBPsvgGkkzuG1nemEYXKdWcU+UxLvqAK1T7CbqGGT+cPLOngLFA3zn+DucloccXPebSAK8NibTdd54tNOw0n7H4elHKiSEaA=="
};
    </script>
    <script src="https://fa4069db5cc8.d76fc783.eu-west-1.token.awswaf.com/fa4069db5cc8/572dccacc257/606967e82dd9/challenge.js"></script>
    <script src="https://fa4069db5cc8.d76fc783.eu-west-1.captcha.awswaf.com/fa4069db5cc8/572dccacc257/606967e82dd9/captcha.js"></script>
</head>
<body>
    <div id="captcha-container"></div>
    <script type="text/javascript">
        AwsWafIntegration.saveReferrer();
        window.addEventListener("load", function() {
          const container = document.querySelector("#captcha-container");
          CaptchaScript.renderCaptcha(container, async (voucher) => {
              await ChallengeScript.submitCaptcha(voucher);
              window.location.reload(true);
          }
      );
    });
    </script>
    <noscript>
        <h1>JavaScript is disabled</h1>
        In order to continue, you need to verify that you're not a robot by solving a CAPTCHA puzzle.
         The CAPTCHA puzzle requires JavaScript. Enable JavaScript and then reload the page.
    </noscript>
</body>
</html>

History

Changes recorded since June 2026.

No change recorded.

In context

Japan
32.2% block at least one AI crawler
Behind Cloudflare
No