timesofisrael.com · Israel · measured 8 Oct 2026
As read on 8 Oct 2026, 1,184 bytes. No rule names an AI crawler.
User-agent: Googlebot-Image Disallow: Allow: /* User-agent: Mediapartners-Google* Disallow: Allow: /* User-agent: duggmirror Disallow: / User-agent: Twitterbot Disallow: Allow: /* User-agent: Googlebot-News Disallow: /announcements/ User-agent: msnbot Crawl-delay: 3 User-agent: weborama-fetcher Disallow: / User-agent: AhrefsBot Disallow: / User-agent: 360Spider Disallow: / User-agent: YisouSpider Disallow: / User-agent: DotBot Disallow: / User-agent: * Disallow: /cgi-bin/ Disallow: /wp-admin/ Disallow: /wp-login.php Disallow: /wp-includes/ Disallow: /wp-content/cache/ Disallow: /trackback/ Disallow: /rss-feed/ Disallow: /feed/ Disallow: /comments/ Disallow: /cities/ Disallow: /types/ Disallow: /anniversaries/ Disallow: /companies/ Disallow: /test-hp/ Disallow: *preview=true* Disallow: /?p=* Disallow: *3933714/TOI* Disallow: /wp-content/themes/rgb/ajax/ Disallow: /wpcontent/themes/rbg/functions/ Sitemap: https://www.timesofisrael.com/sitemap_index.xml Sitemap: https://www.timesofisrael.com/news-sitemap.xml
Changes recorded since June 2026.
No change recorded.