CrawlerPulse
CrawlerPulse / North America / United States / beauregarddailynews.net

Beauregard Daily News

beauregarddailynews.net · United States · USAToday · measured 8 Oct 2026

Google Search
Allowed
Google-Extended
Allowed
OpenAI
Allowed
Anthropic
Allowed
Perplexity
Allowed
Meta
Allowed
Common Crawl
Allowed
ByteDance
Allowed
Apple
Allowed
Amazon
Allowed

robots.txt

As read on 8 Oct 2026, 566 bytes. No rule names an AI crawler.

<!DOCTYPE HTML>
      <html>
        <head>
          <title>404 - Unknown site</title>
        </head>
        <body style="font-family:Arial, Helvetica, sans-serif; text-align: center">
          <div style='padding-block: 180px'>
            <h1>
              <div style='font-size: 180px; font-weight: 700'>404</div>
              <div style='font-size: 24px; font-weight: 700'>Unknown site</div>
            </h1>
            <p style="font-size: 16px; font-weight: 400">The page could not be loaded properly.</p>
          </div>
        </body>
      </html>

History

Changes recorded since June 2026.

No change recorded.

In context

United States
63.2% block at least one AI crawler
Behind Cloudflare
No
Same group