CrawlerPulse
CrawlerPulse / Asia / Indonesia / ayojakarta.com

AyoJakarta.com

ayojakarta.com · Indonesia · PT. AYO MEDIA NETWORK · measured 8 Oct 2026

Google Search
Allowed
Google-Extended
Allowed
OpenAI
Allowed
Anthropic
Allowed
Perplexity
Allowed
Meta
Allowed
Common Crawl
Allowed
ByteDance
Allowed
Apple
Allowed
Amazon
Allowed

robots.txt

As read on 8 Oct 2026, 336 bytes. No rule names an AI crawler.

User-agent: *
Allow: /
Allow: *?page=all
Allow: *?page=1
Allow: *?page=2
Allow: *?page=3
Disallow: *?utm_medium=*
Disallow: *?fbclid=*
Disallow: *?q=*
Disallow: *?page=*
Disallow: */comment
Disallow: /_server-islands/*
Disallow: */topik-khusus.html
Disallow: */topik-khusus-detail.html
Sitemap: https://www.ayojakarta.com/sitemap.xml

History

Changes recorded since June 2026.

No change recorded.

In context

Indonesia
30.4% block at least one AI crawler
Behind Cloudflare
Yes
Same group