CrawlerPulse
CrawlerPulse / Asia / Indonesia / thejakartapost.com

The Jakarta Post

thejakartapost.com · Indonesia · PT Bina Media Tenggara · measured 8 Oct 2026

Google Search
Allowed
Google-Extended
Allowed
OpenAI
Allowed
Anthropic
Allowed
Perplexity
Allowed
Meta
Allowed
Common Crawl
Allowed
ByteDance
Allowed
Apple
Allowed
Amazon
Allowed

robots.txt

As read on 8 Oct 2026, 1,566 bytes. No rule names an AI crawler.

User-agent: *
Disallow: /redirect
Disallow: /testing-showcase.html
Disallow: /TJPSURVEY78
Disallow: /new-single-test.html
Disallow: /qc2024
Disallow: /login
Disallow: /p/*/page/
Allow: /
Sitemap: https://www.thejakartapost.com/sitemap.xml
Sitemap: https://www.thejakartapost.com/sitemap_index.xml
Sitemap: https://www.thejakartapost.com/sitemap_news.xml
Sitemap: https://www.thejakartapost.com/sitemap_web_indonesia.xml
Sitemap: https://www.thejakartapost.com/sitemap_web_business.xml
Sitemap: https://www.thejakartapost.com/sitemap_web_world.xml
Sitemap: https://www.thejakartapost.com/sitemap_web_academia.xml
Sitemap: https://www.thejakartapost.com/sitemap_web_culture.xml
Sitemap: https://www.thejakartapost.com/sitemap_web_longform.xml
Sitemap: https://www.thejakartapost.com/sitemap_web_adv_longform.xml
Sitemap: https://www.thejakartapost.com/sitemap_web_frontrow.xml
Sitemap: https://www.thejakartapost.com/sitemap_web_adv.xml
Sitemap: https://www.thejakartapost.com/sitemap_web_news.xml
Sitemap: https://www.thejakartapost.com/sitemap_web_youth.xml
Sitemap: https://www.thejakartapost.com/sitemap_web_multimedia.xml
Sitemap: https://www.thejakartapost.com/sitemap_web_travel.xml
Sitemap: https://www.thejakartapost.com/sitemap_web_sports.xml
Sitemap: https://www.thejakartapost.com/sitemap_web_life.xml
Sitemap: https://www.thejakartapost.com/sitemap_web_community.xml
Sitemap: https://www.thejakartapost.com/sitemap_web_opinion.xml
Sitemap: https://www.thejakartapost.com/sitemap_web_seasia.xml
Sitemap: https://www.thejakartapost.com/sitemap_images.xml

History

Changes recorded since June 2026.

No change recorded.

In context

Indonesia
30.4% block at least one AI crawler
Behind Cloudflare
No