CrawlerPulse
CrawlerPulse / Africa / Sierra Leone / switsalone.com

Sierra Leone News

switsalone.com · Sierra Leone · Sierra Leone News | Swit Salone · measured 8 Oct 2026

Google Search
Allowed
Google-Extended
Allowed
OpenAI
Allowed
Anthropic
Allowed
Perplexity
Allowed
Meta
Allowed
Common Crawl
Allowed
ByteDance
Allowed
Apple
Allowed
Amazon
Allowed

robots.txt

As read on 8 Oct 2026, 2,056 bytes. No rule names an AI crawler.

User-agent: *
Disallow: /wp-admin/
Allow: /wp-admin/admin-ajax.php
Disallow: /wp-includes/
Allow: /wp-includes/js/
Allow: /wp-includes/images/
Disallow: /trackback/
Disallow: /wp-login.php
Disallow: /wp-register.php

User-agent: *
Disallow: /wp-admin/
Allow: /wp-admin/admin-ajax.php
Disallow: /wp-content/themes/
Disallow: /wp-content/plugins/
Disallow: /*.html
Disallow: /*?
Disallow: /wp-login.php
Disallow: *?p=*
Disallow: *&p=*
Disallow: /404-error/
Allow: /wp-content/uploads/
Allow: /
Disallow: /cgi-bin
Disallow: /wp-
Disallow: /?s=
Disallow: */&s=
Disallow: /feed
Disallow: /search
Disallow: /author/
Disallow: *?attachment_id=
Disallow: */rss
Disallow: /private/
Disallow: /wp-includes/
Disallow: /cgi-bin/
Disallow: */embed
Disallow: */?term=
Disallow: */?PageSpeed=noscript
Disallow: */?post_type=podcast
Disallow: */?page_id=
Allow: /wp-content/plugins/my-plugin/js/
Disallow: */?p=
Disallow: */?ref=
Disallow: */?fpr=
Disallow: */?utm_source=
Disallow: *//admin-ajax.php
Disallow: /*ref=
Disallow: /*term=
Disallow: /*?utm_
Disallow: /*fpr=
Disallow: /*/page
Disallow: /*PageSpeed=
Disallow: /*ver=
Disallow: /*trk=
Disallow: /*utm_
Disallow: *blog/feed/
Disallow: *comments/feed
Allow: /*/*.js
Allow: /*/*.css
Allow: /wp-*.png
Allow: /wp-*.jpg
Allow: /wp-*.jpeg
Allow: /wp-*.gif
Allow: /wp-*.svg
Allow: /wp-*.pdf
Disallow: /secure/checkout/
Disallow: /cdn-cgi/l/email-protection
Disallow: /*/feed/
Disallow: /order-confirmed/
Disallow: /blogs/page/*/?et_blog
Disallow: /blogs/?et_blog
Disallow: /category/*page/*/
Disallow: /date/*/*/page/*/
Disallow: /author/jane-williams/page/*/
Disallow: /?elementor_library=
Disallow: /*/?replytocom=5281
Disallow: /search/page/*/
Disallow: /category/news/page/*/?filter_by=*
Disallow: /date/*/page/
Disallow: /my-account/view-order/
Disallow: /category/news-politics/?filter_by=*

History

Changes recorded since June 2026.

No change recorded.

In context

Sierra Leone
5.9% block at least one AI crawler
Behind Cloudflare
No