CrawlerPulse
CrawlerPulse / North America / United States / drudgereport.com

Drudge Report

drudgereport.com · United States · measured 9 Oct 2026

Google Search
Allowed
Google-Extended
Allowed
OpenAI
Allowed
Anthropic
Allowed
Perplexity
Allowed
Meta
Allowed
Common Crawl
Allowed
ByteDance
Allowed
Apple
Allowed
Amazon
Allowed

robots.txt

As read on 9 Oct 2026, 3,250 bytes. No rule names an AI crawler.

<!doctype html>
<html lang="en">
<head>
  <meta charset="utf-8" />
  <meta http-equiv="x-ua-compatible" content="ie=edge" />
  <meta name="viewport" content="width=device-width, initial-scale=1" />
  <meta name="robots" content="noindex, nofollow" />
  <title>DRUDGE REPORT - 404</title>
  <style>
    * { box-sizing: border-box; margin: 0; padding: 0; }
    html { height: 100%; }
    tt { font-family: "Courier New", Courier, monospace; }
    body {
      min-height: 100%;
      display: flex;
      flex-direction: column;
      align-items: center;
      justify-content: center;
      background: #fff;
      color: #000;
      font-family: ARIAL,VERDANA,HELVETICA;
      line-height: 1.35;
      padding: 40px 20px;
    }
    .page {
      max-width: 620px;
      width: 100%;
      text-align: center;
    }
    /* Masthead */
    .masthead a {
      font-size: clamp(18px, 4vw, 24px);
      font-weight: bold;
      letter-spacing: 3px;
      text-transform: uppercase;
      color: #000;
      text-decoration: none;
    }
    .tagline {
      font-size: 10px;
      letter-spacing: 1.5px;
      text-transform: uppercase;
      color: #999;
      margin-top: 2px;
    }
    .rule {
      border: none;
      border-top: 1px solid #ccc;
      margin: 28px 0;
    }
    /* Error number */
    .error-code {
      font-size: clamp(72px, 18vw, 144px);
      font-weight: bold;
      line-height: 1;
      letter-spacing: -4px;
      color: #e8e8e8;
      margin-bottom: 8px;
    }
    .headline {
      font-size: clamp(22px, 5vw, 34px);
      font-weight: bold;
      text-transform: uppercase;
      letter-spacing: 1px;
    }
    .description {
      font-size: clamp(14px, 2.5vw, 17px);
      color: #666;
      margin-top: 12px;
      line-height: 1.5;
    }
    /* Navigation */
    .nav {
      margin-top: 36px;
      display: flex;
      justify-content: center;
      gap: 24px;
      flex-wrap: wrap;
    }
    .nav a {
      font-size: 14px;
      font-weight: bold;
      letter-spacing: 1.5px;
      text-transform: uppercase;
      color: #000;
      text-decoration: none;
      padding-bottom: 2px;
      border-bottom: 1px solid #ccc;
      transition: border-color 0.2s;
    }
    .nav a:hover {
      border-bottom-color: #000;
    }
    /* Footer */
    .status {
      margin-top: 48px;
      font-size: 11px;
      letter-spacing: 2px;
      text-transform: uppercase;
      color: #bbb;
    }
  </style>
</head>
<body>
  <div class="page">
    <div class="masthead">
      <img src="https://www.drudgereport.com/i/logo9.gif" style="max-width: 64%;">
    </div>
    <hr class="rule" />
    <div class="error-code"><tt>404</tt></div>
    <h1 class="headline">Page Not Found</h1>
    <p class="description">
      <tt>The page you requested has been moved or no longer exists.</tt>
    </p>
    <nav class="nav">
      <a href="/"><tt>Headlines</tt></a>
      <a href="javascript:history.back()"><tt>Go Back</tt></a>
      <a href="javascript:location.reload()"><tt>Refresh</tt></a>
    </nav>
    <div class="status"><tt>HTTP 404</tt></div>
  </div>
</body>
</html>

History

Changes recorded since June 2026.

No change recorded.

In context

United States
63.2% block at least one AI crawler
Behind Cloudflare
No