CrawlerPulse
CrawlerPulse / Asia / Japan / lite-ra.com

本と雑誌のニュースサイト/リテラ

lite-ra.com · Japan · measured 8 Oct 2026

Google Search
Blocked
Google-Extended
Blocked
OpenAI
Blocked
Anthropic
Blocked
Perplexity
Blocked
Meta
Blocked
Common Crawl
Blocked
ByteDance
Blocked
Apple
Blocked
Amazon
Blocked

robots.txt

As read on 8 Oct 2026, 487 bytes. No rule names an AI crawler.

User-Agent: *
Disallow: /images/
Disallow: /*&$
Disallow: /*href=$
Disallow: /*.$
Disallow: /*entry$
Disallow: /*post$
Disallow: /*post-$
Disallow: /*...$
Disallow: /*?$
Disallow: /*asyuracom
Disallow: /contact/
Disallow: /dev/contact/press/
Disallow: /publisher.html
Disallow: /about.html
Sitemap: https://lite-ra.com/sitemap.xml
Sitemap: https://lite-ra.com/i/sitemap.xml
sitemap: https://lite-ra.com/urllist_entry1.txt
sitemap: https://lite-ra.com/urllist_tag1.txt

History

Changes recorded since June 2026.

No change recorded.

In context

Japan
32.2% block at least one AI crawler
Behind Cloudflare
No