CrawlerPulse
CrawlerPulse / Asia / Japan / roomie.jp

ROOMIE(ルーミー)

roomie.jp · Japan · measured 8 Oct 2026

Google Search
Allowed
Google-Extended
Allowed
OpenAI
Blocked
Anthropic
Blocked
Perplexity
Allowed
Meta
Blocked
Common Crawl
Blocked
ByteDance
Blocked
Apple
Allowed
Amazon
Blocked

robots.txt

As read on 8 Oct 2026, 3,441 bytes. 9 rule groups name AI crawlers; shown first.

User-agent: GPTBot
Disallow: /

User-agent: meta-externalagent
Disallow: /

User-agent: ClaudeBot
Disallow: /

User-agent: Amazonbot
Disallow: /

User-agent: ChatGPT-User
Disallow: /

User-agent: Bytespider
Disallow: /

User-agent: CCBot
Disallow: /

User-agent: Timpibot
Disallow: /

User-agent: omgilibot
Disallow: /

User-agent: *
Disallow: /wp-admin/
Allow: /wp-admin/admin-ajax.php
Disallow: /api/pv-count.php
Disallow: /wp-content/plugins/wp-pic-tagger/php/notes.php
Disallow: /wp-json/
Disallow: /*?wovn=
Disallow: /*?*wovn=
Disallow: /*?lang=
Disallow: /*?labels=
Disallow: /*?*preview=
Disallow: /*?preview_id=
Disallow: /*?p=
Disallow: /*?itm_source=
Disallow: /*?*&itm_source=
Disallow: /*?top_pickup_amazonsale
Disallow: /*?q=
Disallow: /*?*&lang=
Disallow: /?p=
Disallow: /?m=
Disallow: /?cat=
Disallow: /?tag=
Disallow: /?author=
Disallow: /*?ref=
Disallow: /*?*ref=
Disallow: /*?usqp=
Disallow: /*?*usqp=
Disallow: /*?epik=
Disallow: /*?*epik=
Disallow: /*?seo_related
Disallow: /*?related
Disallow: /*?*related
Disallow: /*?cx_click=
Disallow: /*?cx_testId=
Disallow: /*?*&cx_testId=
Disallow: /*?cx_artPos=
Disallow: /*?*cx_artPos=
Disallow: /*?cx_recsMode=
Disallow: /*?*cx_recsMode=
Disallow: /*?fbclid=
Disallow: /*?*fbclid=
Disallow: /*/feed/
Disallow: /comments/feed/
Disallow: /tags_detail/
Disallow: /tags/
Disallow: /tags/*/page/
Disallow: /tag/
Disallow: /tag/*/page/
Disallow: /category/*/page/
Disallow: /category/*/*/page/
Disallow: /feature/*/page/
Disallow: /special/*/page/
Disallow: /multibrandstore/page/
Disallow: /rkfeature/*/page/
Disallow: /writer-all/
Disallow: /writer-all/page/
Disallow: /writer/page/
Disallow: /writer/*_rel=
Disallow: /date/
Disallow: /20*/*/*/&title=
Disallow: /9/$
Disallow: /*?s=
Disallow: /*&s=
Disallow: /20*/*/*/kitchen/about/
Disallow: /page/
Disallow: /*/page/*/page/
Disallow: /20*/*/*/page/
Disallow: /*/page/
Allow: /*/page/2/$
Allow: /*/page/3/$
Allow: /*/page/4/$
Allow: /*/page/5/$
Allow: /*/page/6/$
Allow: /*/page/7/$
Allow: /*/page/8/$
Allow: /*/page/9/$
Allow: /*/page/10/$
Allow: /*/page/11/$
Allow: /*/page/12/$
Allow: /*/page/13/$
Allow: /*/page/14/$
Allow: /*/page/15/$
Allow: /*/page/16/$
Allow: /*/page/17/$
Allow: /*/page/18/$
Allow: /*/page/19/$
Allow: /*/page/20/$
Allow: /*/page/21/$
Allow: /*/page/22/$
Allow: /*/page/23/$
Allow: /*/page/24/$
Allow: /*/page/25/$
Allow: /*/page/26/$
Allow: /*/page/27/$
Allow: /*/page/28/$
Allow: /*/page/29/$
Allow: /*/page/30/$
Allow: /*/page/31/$
Allow: /*/page/32/$
Allow: /*/page/33/$
Allow: /*/page/34/$
Allow: /*/page/35/$
Allow: /*/page/36/$
Allow: /*/page/37/$
Allow: /*/page/38/$
Allow: /*/page/39/$
Allow: /*/page/40/$
Allow: /*/page/41/$
Allow: /*/page/42/$
Allow: /*/page/43/$
Allow: /*/page/44/$
Allow: /*/page/45/$
Allow: /*/page/46/$
Allow: /*/page/47/$
Allow: /*/page/48/$
Allow: /*/page/49/$
Allow: /*/page/50/$

User-agent: Mediapartners-Google
Allow: /

User-agent: AmazonAdBot
Allow: /
Sitemap: https://www.roomie.jp/sitemap-allpost.xml
Sitemap: https://www.roomie.jp/sitemap-news.xml

History

Changes recorded since June 2026.

No change recorded.

In context

Japan
32.2% block at least one AI crawler
Behind Cloudflare
No