CrawlerPulse
CrawlerPulse / Asia / Japan / jetro.go.jp

jetro.go.jp

jetro.go.jp · Japan · measured 8 Oct 2026

Google Search
Allowed
Google-Extended
Allowed
OpenAI
Allowed
Anthropic
Allowed
Perplexity
Allowed
Meta
Allowed
Common Crawl
Allowed
ByteDance
Allowed
Apple
Allowed
Amazon
Allowed

robots.txt

As read on 8 Oct 2026, 1,825 bytes. No rule names an AI crawler.

User-agent: WiSEWebCrawler
Disallow: /all_search_result.html
Disallow: /database/search_result.html
Disallow: /database/login.html
Disallow: /bidtop.html
Disallow: /biznewstop.html
Disallow: /case_studytop.html
Disallow: /eventstop.html
Disallow: /exportguidetop.html
Disallow: /featuretop.html
Disallow: /industrytop.html
Disallow: /investtop.html
Disallow: /lawtop.html
Disallow: /marketingtop.html
Disallow: /publicationstop.html
Disallow: /publicoffertop.html
Disallow: /worldtop.html
Disallow: /qatop.html
Disallow: /reportstop.html
Disallow: /seminartop.html
Disallow: /specialtop.html
Disallow: /stop.html
Disallow: /themetop.html
Disallow: /topicstop.html
Disallow: /tvtop.html
Disallow: /w-infotop.html
Disallow: /worldtop.html
Disallow: /o_seminartop.html
Disallow: /ipnewstop.html
Disallow: /ipinfotop.html
Disallow: /legaltop.html
Disallow: /zonetop.html
Disallow: /exportguidetop.html
Disallow: /l_tradetop.html
Disallow: /l_fditop.html
Disallow: /othercontentstop.html
Disallow: /columntop.html
Disallow: /servicestop.html
Disallow: /biznews/archive.html
Disallow: /en/
Disallow: /australia/
Disallow: /austria/
Disallow: /bangladesh/
Disallow: /belgium/
Disallow: /brazil/
Disallow: /canada/
Disallow: /chile/
Disallow: /china/
Disallow: /costarica/
Disallow: /egypt/
Disallow: /france/
Disallow: /germany/
Disallow: /hongkong/
Disallow: /hungary/
Disallow: /indonesia/
Disallow: /israel/
Disallow: /italy/
Disallow: /korea/
Disallow: /malaysia/
Disallow: /mexico/
Disallow: /netherlands/
Disallow: /newzealand/
Disallow: /pakistan/
Disallow: /peru/
Disallow: /philippines/
Disallow: /poland/
Disallow: /saudiarabia/
Disallow: /singapore/
Disallow: /spain/
Disallow: /switzerland/
Disallow: /thailand/
Disallow: /turkey/
Disallow: /uae/
Disallow: /uk/
Disallow: /usa/
Disallow: /uzbekistan/
Disallow: /vietnam/

History

Changes recorded since June 2026.

No change recorded.

In context

Japan
32.2% block at least one AI crawler
Behind Cloudflare
No