CrawlerPulse
CrawlerPulse / Europe / Russia / tyum-pravda.ru

tyum-pravda.ru

tyum-pravda.ru · Russia · measured 8 Oct 2026

Google Search
Allowed
Google-Extended
Allowed
OpenAI
Allowed
Anthropic
Allowed
Perplexity
Allowed
Meta
Allowed
Common Crawl
Allowed
ByteDance
Allowed
Apple
Allowed
Amazon
Allowed

robots.txt

As read on 8 Oct 2026, 1,632 bytes. No rule names an AI crawler.

<!DOCTYPE html>
<html lang="ru">
<head>
    <meta charset="utf-8">
    <meta http-equiv="X-UA-Compatible" content="IE=edge">
    <meta name="viewport" content="width=device-width, initial-scale=1">
    <meta name="description" content="">
    <meta name="author" content="">
    <title>404 Not Found</title>
    <link href="/i/css/bootstrap.min.css" rel="stylesheet">
    <link href="/i/css/plugins/metisMenu/metisMenu.min.css" rel="stylesheet">
    <link href="/i/css/sb-admin-2.css" rel="stylesheet">
    <link href="/i/font-awesome-4.1.0/css/font-awesome.min.css" rel="stylesheet" type="text/css">
    <!--[if lt IE 9]>
        <script src="https://oss.maxcdn.com/libs/html5shiv/3.7.0/html5shiv.js"></script>
        <script src="https://oss.maxcdn.com/libs/respond.js/1.4.2/respond.min.js"></script>
    <![endif]-->
</head>
<body>
    <div class="container">
        <div class="row">
            <div class="col-md-4 col-md-offset-4">
                <div class="login-panel panel panel-default">
                    <div class="panel-heading">
			<a href="/"><img src="/i/logo.png" alt="Logo" title="" width="220"></a><br>
                    </div>
                    <div class="panel-body">
			<h1>404</h1>
			Запрашиваемая страница не найдена / Page not found
                    </div>
                </div>
            </div>
        </div>
    </div>
    <script src="/i/js/jquery-1.11.0.js"></script>
    <script src="/i/js/bootstrap.min.js"></script>
    <script src="/i/js/plugins/metisMenu/metisMenu.min.js"></script>
    <script src="/i/js/sb-admin-2.js"></script>
</body>
</html>

History

Changes recorded since June 2026.

No change recorded.

In context

Russia
6.3% block at least one AI crawler
Behind Cloudflare
No