rotter.net

rotter.net · Israel · measured 9 Oct 2026

Google Search

Allowed

Google-Extended

Allowed

OpenAI

Allowed

Anthropic

Allowed

Perplexity

Allowed

robots.txt

As read on 9 Oct 2026, 581 bytes. No rule names an AI crawler.

User-agent: msnbot
Crawl-delay: 20
Request-rate: 1/2
Visit-time: 0300-0500

User-agent: *
Disallow: /cgi-bin/forum/dcadmin.cgi
Disallow: /cgi-bin/forum/dcboard.cgi?az=subscribe_to_topic
Disallow: /cgi-bin/forum/dcboard.cgi?az=do_anchor
Disallow: /cgi-bin/forum/dcboard.cgi?quote=not_empty
Disallow: /cgi-bin/forum/dcboard.cgi?az=edit
Disallow: /cgi-bin/forum/dcboard.cgi?az=post
Disallow: /cgi-bin/forum/dcboard.cgi?az=add_bookmark
Disallow: /cgi-bin/forum/dcboard.cgi?az=up
Disallow: /cgi-bin/forum/dcboard.cgi?az=anchor_down
Disallow: /cgi-bin/forum/dcboard.cgi?az=printer_format

History

Changes recorded since June 2026.

No change recorded.

In context

Israel

17.2% block at least one AI crawler

Behind Cloudflare

Yes