CrawlerPulse
CrawlerPulse / Asia / Turkey / istanbulpost.net

istanbulpost.net

istanbulpost.net · Turkey · measured 8 Oct 2026

Google Search
Allowed
Google-Extended
Allowed
OpenAI
Allowed
Anthropic
Allowed
Perplexity
Allowed
Meta
Allowed
Common Crawl
Allowed
ByteDance
Allowed
Apple
Allowed
Amazon
Allowed

robots.txt

As read on 8 Oct 2026, 1,658 bytes. No rule names an AI crawler.

<!DOCTYPE html>
<html lang="en">
<head>
<meta charset="utf-8">
<meta name="viewport" content="width=device-width,initial-scale=1">
<title>404 Not Found</title>
<style>html{color-scheme:light dark}body{margin:0;min-height:100vh;display:flex;align-items:center;justify-content:center;background:#f6f7f9;color:#1c1f23;font:16px/1.5 -apple-system,BlinkMacSystemFont,'Segoe UI',Roboto,Helvetica,Arial,sans-serif}.card{max-width:34rem;padding:2.5rem 2rem;text-align:center}.code{margin:0;font-size:4.5rem;font-weight:700;line-height:1;letter-spacing:-.03em;color:#c9ced3;font-variant-numeric:tabular-nums}h1{margin:.5rem 0 0;font-size:1.375rem;font-weight:600}.say{margin:.625rem 0 0;color:#5c636a}.rule{margin:2rem auto 0;width:3rem;border-top:1px solid #dadee1}.by{margin:1rem 0 0;font-size:.75rem;letter-spacing:.1em;text-transform:uppercase;color:#8b9299}@media(prefers-color-scheme:dark){body{background:#141719;color:#e6e8ea}.code{color:#3f474f}.say{color:#9aa0a6}.rule{border-color:#2a2f34}.by{color:#767c82}}</style>
</head>
<body>
<div class="card">
<p class="code">404</p>
<h1>Not Found</h1>
<p class="say">The page you were looking for is not on this server.</p>
<div class="rule"></div>
<p class="by">gws</p>
</div>
</body>
</html>
<!-- a padding to disable MSIE and Chrome friendly error page -->
<!-- a padding to disable MSIE and Chrome friendly error page -->
<!-- a padding to disable MSIE and Chrome friendly error page -->
<!-- a padding to disable MSIE and Chrome friendly error page -->
<!-- a padding to disable MSIE and Chrome friendly error page -->
<!-- a padding to disable MSIE and Chrome friendly error page -->

History

Changes recorded since June 2026.

No change recorded.

In context

Turkey
11.8% block at least one AI crawler
Behind Cloudflare
No