CrawlerPulse
CrawlerPulse / Asia / Iran / goaldaily.ir

روزنامه ورزشی گل

goaldaily.ir · Iran · روزنامه ورزشی گل | روزنامه ورزشی گل · measured 8 Oct 2026

Google Search
Allowed
Google-Extended
Allowed
OpenAI
Allowed
Anthropic
Allowed
Perplexity
Allowed
Meta
Allowed
Common Crawl
Allowed
ByteDance
Allowed
Apple
Allowed
Amazon
Allowed

robots.txt

As read on 8 Oct 2026, 393 bytes. No rule names an AI crawler.

<html>
<head>
	<meta charset="utf-8">
	<meta name="viewport" content="width=device-width, initial-scale=1, maximum-scale=1, user-scalable=no">
	<title>Page not found!</title>
</head>
<body>
	<div class="container-fluid">
		<div class="row">
			<div class="col-xs-12" style="text-align: center">
				صفحه مورد نظر پیدا نشد..
			</div>
		</div>
	</div>
</body>
</html>

History

Changes recorded since June 2026.

No change recorded.

In context

Iran
5.6% block at least one AI crawler
Behind Cloudflare
No