naijalog.com

naijalog.com · Nigeria · measured 8 Oct 2026

Google Search

Allowed

Google-Extended

Allowed

OpenAI

Allowed

Anthropic

Allowed

Perplexity

Allowed

robots.txt

As read on 8 Oct 2026, 608 bytes. No rule names an AI crawler.

User-agent: *
Disallow: /cgi-bin/
Disallow: /wp-admin/
Disallow: /trackback/
Disallow: /*/trackback/$
Disallow: /search/
Disallow: /rss/
Disallow: /comments/
Disallow: /comments/feed
Disallow: /*/trackback/
Disallow: /feed/$
Disallow: /*/feed/$
Disallow: /*/feed/rss/$
Disallow: /*/feed/
Disallow: /*/comments/
Disallow: /?p=
Disallow: /archives/
Disallow: /login/
Disallow: /*.inc$
Disallow: /out/
Allow: /wp-admin/admin-ajax.php

User-agent: Yandex
Disallow: /

User-agent: Baiduspider
Disallow: /

User-agent: *
Disallow: /wp-content/cache/

History

Changes recorded since June 2026.

No change recorded.

In context

Nigeria

6.6% block at least one AI crawler

Behind Cloudflare

Yes