CrawlerPulse
CrawlerPulse / Africa / Republic of the Congo / africanews.com

Africanews

africanews.com · Republic of the Congo · measured 9 Oct 2026

Google Search
Allowed
Google-Extended
Allowed
OpenAI
Allowed
Anthropic
Allowed
Perplexity
Allowed
Meta
Allowed
Common Crawl
Allowed
ByteDance
Allowed
Apple
Allowed
Amazon
Allowed

robots.txt

As read on 9 Oct 2026, 534 bytes. No rule names an AI crawler.

User-agent: Googlebot
Disallow: /api/weather/coords/

User-agent: *
Disallow: /api/
Disallow: /media/Player6_0.swf*
Disallow: js/main-*.js
Disallow: js/streamsense-*.min.js
Disallow: /modules
Disallow: /plugin
Disallow: /src
Disallow: /handler
Disallow: /utils
Disallow: /lib
Disallow: /helper
Disallow: /update_
Disallow: /instances
Disallow: /dom
Disallow: /class
Disallow: /client
Sitemap: https://www.africanews.com/sitemaps/en/sitemap.xml

History

Changes recorded since June 2026.

No change recorded.

In context

Republic of the Congo
0.0% block at least one AI crawler
Behind Cloudflare
No