gabonreview.com

gabonreview.com · Gabon · measured 8 Oct 2026

Google Search

Allowed

Google-Extended

Partial

OpenAI

Partial

Anthropic

Partial

Perplexity

Partial

robots.txt

As read on 8 Oct 2026, 1,019 bytes. No rule names an AI crawler.

    User-agent: *
    Disallow: /cgi-bin
    Disallow: /wp-admin
    Disallow: /wp-includes
    Disallow: /wp-content/plugins
    Disallow: /wp-content/themes
    Disallow: /trackback
    Disallow: /feed
    Disallow: /category/*/*
    Disallow: */trackback
    Disallow: /*?*
    Disallow: /*?
    Disallow: /?*
    Allow: /wp-content/uploads
    Allow: /wp-content/blogs.dir
    User-agent: Googlebot
    Disallow: /*.php$
    Disallow: /*.js$
    Disallow: /*.inc$
    Disallow: /*.css$
    Disallow: /*.gz$
    Disallow: /*.swf$
    Disallow: /*.wmv$
    Disallow: /*.cgi$
    User-agent: Googlebot-Image
    Disallow:
    Allow: /*
    User-agent: Mediapartners-Google*
    Disallow:
    Allow: /*

History

Changes recorded since June 2026.

No change recorded.

In context

Gabon

28.6% block at least one AI crawler

Behind Cloudflare