jpost.com · Israel · measured 8 Oct 2026
As read on 8 Oct 2026, 2,431 bytes. 4 rule groups name AI crawlers; shown first.
User-agent: GPTBot Allow: / Disallow: /showimage.ashx* Disallow: /premiumlogin/ Disallow: /servlet/ Disallow: /printarticle.aspx* Disallow: /pdf/ Disallow: /directory/ Disallow: /search;query Disallow: /comments/ Disallow: /test-ads/ Disallow: /insights/ Disallow: /insights/ User-agent: ChatGPT-User Allow: / Disallow: /showimage.ashx* Disallow: /premiumlogin/ Disallow: /servlet/ Disallow: /printarticle.aspx* Disallow: /pdf/ Disallow: /directory/ Disallow: /search;query Disallow: /comments/ Disallow: /test-ads/ Disallow: /insights/ Disallow: /insights/ User-agent: OAI-SearchBot Allow: / Disallow: /showimage.ashx* Disallow: /premiumlogin/ Disallow: /servlet/ Disallow: /printarticle.aspx* Disallow: /pdf/ Disallow: /directory/ Disallow: /search;query Disallow: /comments/ Disallow: /test-ads/ Disallow: /insights/ Disallow: /insights/ User-agent: ChatGPT-User Allow: / Disallow: /showimage.ashx* Disallow: /premiumlogin/ Disallow: /servlet/ Disallow: /printarticle.aspx* Disallow: /pdf/ Disallow: /directory/ Disallow: /search;query Disallow: /comments/ Disallow: /test-ads/ Disallow: /insights/ Disallow: /insights/ User-agent: Googlebot Disallow: /showimage.ashx* Disallow: /premiumlogin/ Disallow: /servlet/ Disallow: /printarticle.aspx* Disallow: /pdf/ Disallow: /directory/ Disallow: /search;query Disallow: /comments/ Disallow: /test-ads/ Disallow: /insights/ Disallow: /insights/ User-agent: Twitterbot Allow: /kabbalah Allow: /cybertech Disallow: /trackback/ Disallow: /search;query Disallow: /comments/ User-agent: Claude-User Allow: / Disallow: /showimage.ashx* Disallow: /premiumlogin/ Disallow: /servlet/ Disallow: /printarticle.aspx* Disallow: /pdf/ Disallow: /directory/ Disallow: /search;query Disallow: /comments/ Disallow: /test-ads/ Disallow: /insights/ Disallow: /insights/ User-agent: Perplexity-User Allow: / Disallow: /showimage.ashx* Disallow: /premiumlogin/ Disallow: /servlet/ Disallow: /printarticle.aspx* Disallow: /pdf/ Disallow: /directory/ Disallow: /search;query Disallow: /comments/ Disallow: /test-ads/ Disallow: /insights/ Disallow: /insights/ Sitemap: https://www.jpost.com/GoogleNewsSiteMap/GNSiteMap Sitemap: https://www.jpost.com/jpgooglesitemap/sitemapindex.xml Sitemap: https://www.jpost.com/jpgooglesitemap/latestarticles
Changes recorded since June 2026.
No change recorded.