CrawlerPulse
CrawlerPulse / North America / United States / ugo.com

ugo.com

ugo.com · United States · gamepen.ugo.com · measured 9 Oct 2026

Google Search
Allowed
Google-Extended
Allowed
OpenAI
Allowed
Anthropic
Allowed
Perplexity
Allowed
Meta
Allowed
Common Crawl
Allowed
ByteDance
Allowed
Apple
Allowed
Amazon
Allowed

robots.txt

As read on 9 Oct 2026, 345 bytes. No rule names an AI crawler.

<html>
<head><title>404 Not Found</title></head>
<body>
<h1>404 Not Found</h1>
<ul>
<li>Code: NoSuchKey</li>
<li>Message: The specified key does not exist.</li>
<li>Key: robots.txt</li>
<li>RequestId: WYPTKANQBBDS0E01</li>
<li>HostId: g/ziqMjATaCdJnHzlRo/OVS8MUhoMUBah5+o5LspnSvUeb1PWGfIGLhuthIVLgdxsd4At5QP0oM=</li>
</ul>
<hr/>
</body>
</html>

History

Changes recorded since June 2026.

No change recorded.

In context

United States
63.2% block at least one AI crawler
Behind Cloudflare
No