CrawlerPulse
CrawlerPulse / Asia / Indonesia / tirto.id

Tirto.id

tirto.id · Indonesia · Tujuh Cahaya Sentosa · measured 8 Oct 2026

Google Search
Allowed
Google-Extended
Allowed
OpenAI
Allowed
Anthropic
Allowed
Perplexity
Allowed
Meta
Allowed
Common Crawl
Allowed
ByteDance
Allowed
Apple
Allowed
Amazon
Allowed

robots.txt

As read on 8 Oct 2026, 543 bytes. No rule names an AI crawler.

User-agent: *
Disallow: */embed/
Disallow: *?next*
Disallow: /apis
Disallow: /search*
Disallow: /pd/browse*
Disallow: /pd/*
Disallow: /documents/*
Disallow: /ajax/*
Disallow: /onesignal
Disallow: /payment/*
Disallow: /index.php*
Sitemap: https://tirto.id/sitemap/s/sitemap_basic.xml
Sitemap: https://tirto.id/sitemap/s/sitemap_latest.xml
Sitemap: https://tirto.id/sitemap/s/sitemap_image.xml
Sitemap: https://tirto.id/sitemap/r/generate-article
Sitemap: https://tirto.id/sitemap/s/sitemap_video.xml
Sitemap: https://tirto.id/sitemap/news.xml

History

Changes recorded since June 2026.

No change recorded.

In context

Indonesia
30.4% block at least one AI crawler
Behind Cloudflare
Yes