azernews.az

azernews.az · Azerbaijan · measured 8 Oct 2026

Google Search

Allowed

Google-Extended

Allowed

OpenAI

Allowed

Anthropic

Allowed

Perplexity

Allowed

robots.txt

As read on 8 Oct 2026, 731 bytes. No rule names an AI crawler.

    User-agent: Googlebot
    Disallow: /index.php
    Disallow: /cgi-bin/
    Disallow: /dataimage/
    Disallow: /admin/
    Disallow: /import/
    Disallow: /registration.php
    Disallow: /search.php
    Disallow: *Desktop/
    Disallow: /news_print.php
Sitemap: https://www.azernews.az/sitemap_en.xml
    User-agent: Mediapartners-Google
    Disallow:
    User-agent: *
    User-agent: Googlebot
    Disallow: /index.php
    Disallow: /cgi-bin/
    Disallow: /dataimage/
    Disallow: /admin/
    Disallow: /import/
    Disallow: /registration.php
    Disallow: /search.php
    Disallow: *Desktop/
    Disallow: /news_print.php
Sitemap: https://www.azernews.az/sitemap_en.xml
Host: www.azernews.az

History

Changes recorded since June 2026.

No change recorded.

In context

Azerbaijan

2.3% block at least one AI crawler

Behind Cloudflare

Yes