CrawlerPulse
CrawlerPulse / Asia / Israel / israelnationalnews.com

israelnationalnews.com

israelnationalnews.com · Israel · measured 8 Oct 2026

Google Search
Allowed
Google-Extended
Allowed
OpenAI
Allowed
Anthropic
Allowed
Perplexity
Allowed
Meta
Allowed
Common Crawl
Allowed
ByteDance
Allowed
Apple
Allowed
Amazon
Allowed

robots.txt

As read on 8 Oct 2026, 1,062 bytes. No rule names an AI crawler.

User-agent: *
Host: www.israelnationalnews.com
Disallow: /Controls/
Disallow: /search
Disallow: /forum/search
Disallow: /Generic/IOS/
Disallow: /ForumPost/
Disallow: /Forum/User/*
Disallow: /My/PrivateBox/*
Disallow: /Search/*
Disallow: /Album.aspx/*
Disallow: /digest
Disallow: /flashes/1*$
Disallow: /flashes/2*$
Disallow: /flashes/3*$
Disallow: /flashes/4*$
Disallow: /flashes/5*$
Disallow: /News/Section.aspx/28
Disallow: /section/28
Disallow: /News/Section.aspx/1
Disallow: /section/1
Disallow: /News/Section.aspx/13
Disallow: /section/13
Disallow: /News/Section.aspx/15
Disallow: /section/15
Disallow: /News/Section.aspx/21
Disallow: /section/21
Disallow: /News/Section.aspx/29
Disallow: /section/29
Disallow: /News/Section.aspx/3
Disallow: /section/3
Disallow: /News/Section.aspx/36
Disallow: /section/36
Disallow: /News/Section.aspx/6
Disallow: /section/6
Disallow: /News/Section.aspx/8
Disallow: /section/8
Disallow: /News/Section.aspx/9
Disallow: /section/9
Sitemap: https://www.israelnationalnews.com/sitemap.xml

History

Changes recorded since June 2026.

No change recorded.

In context

Israel
17.2% block at least one AI crawler
Behind Cloudflare
No