CrawlerPulse
CrawlerPulse / Africa / South Africa / sleekfm.com

sleekfm.com

sleekfm.com · South Africa · measured 8 Oct 2026

Google Search
Partial
Google-Extended
Partial
OpenAI
Partial
Anthropic
Partial
Perplexity
Partial
Meta
Partial
Common Crawl
Partial
ByteDance
Partial
Apple
Partial
Amazon
Partial

robots.txt

As read on 8 Oct 2026, 472 bytes. No rule names an AI crawler.

User-agent: *
Disallow: /cgi-bin/
Disallow: /forms/
Disallow: /wp-content/
Disallow: /wp-systcon
Disallow: /wp-json/
Disallow: /wp-statistics/
Disallow: /wp-admin/
Disallow: /wp-includes/
Disallow: /onlineforms/
Disallow: /wp-content/uploads/
Disallow: /temp/
Disallow: /tmp/
Disallow: /logout.php
Disallow: */.feed$
Disallow: /tag/
Disallow: /category/
Disallow: /author/
Disallow: /archive/
Disallow: /date/
Disallow: /1000
Disallow: /feed$
Disallow: /404
Disallow: /?s=

History

Changes recorded since June 2026.

No change recorded.

In context

South Africa
22.1% block at least one AI crawler
Behind Cloudflare
No