CrawlerPulse
CrawlerPulse / Asia / Israel / walla.co.il

walla.co.il

walla.co.il · Israel · measured 8 Oct 2026

Google Search
Allowed
Google-Extended
Allowed
OpenAI
Allowed
Anthropic
Allowed
Perplexity
Allowed
Meta
Allowed
Common Crawl
Allowed
ByteDance
Allowed
Apple
Allowed
Amazon
Allowed

robots.txt

As read on 8 Oct 2026, 642 bytes. No rule names an AI crawler.

User-agent: *
Disallow: *&timeStamp=
Disallow: *@entity
Disallow: *@opinion
Disallow: *@placation
Disallow: *@poll.results
Disallow: /&tagfly=1
Disallow: *@search&
Disallow: *hotOrNot.commit
Disallow: /43010785/*
Disallow: */userfeedback/facebook.stream.publish
Disallow: *mobile=*
Disallow: *?0*
Disallow: *?feature
Disallow: *layout=
Disallow: /*?mediazone*
Disallow: /*&mediazone*
Disallow: *navindex=*
Disallow: /*?fallback*
Disallow: /*?fb_comment_id*
Disallow: /player.html*
Disallow: /rm*
Disallow: *?_w_open_tlk

User-agent: Mediapartners-Google
Allow: /

History

Changes recorded since June 2026.

No change recorded.

In context

Israel
17.2% block at least one AI crawler
Behind Cloudflare
No