CrawlerPulse
CrawlerPulse / Europe / Romania / bursa.ro

bursa

bursa.ro · Romania · measured 8 Oct 2026

Google Search
Allowed
Google-Extended
Allowed
OpenAI
Allowed
Anthropic
Allowed
Perplexity
Allowed
Meta
Allowed
Common Crawl
Allowed
ByteDance
Allowed
Apple
Allowed
Amazon
Allowed

robots.txt

As read on 8 Oct 2026, 1,428 bytes. 1 rule group name AI crawlers; shown first.

User-agent: meta-externalagent
Allow: /

User-agent: BabilonAI-NewsIngest
Disallow: /

User-agent: AhrefsBot
Disallow: /

User-agent: AhrefsSiteAudit
Disallow: /

User-agent: SemrushBot
Disallow: /

User-agent: MJ12bot
Disallow: /

User-agent: DotBot
Disallow: /

User-agent: DataForSeoBot
Disallow: /

User-agent: BLEXBot
Disallow: /

User-agent: SERankingBacklinksBot
Disallow: /

User-agent: facebookexternalhit
Allow: /

User-agent: facebookcatalog
Allow: /

User-agent: *
Disallow: /_a_d_m/
Disallow: /_cache/
Disallow: /_config/
Disallow: /_content/
Disallow: /_documente/cotatii_agricole/
Disallow: /_java
Disallow: /_module/
Disallow: /_rss_old/
Disallow: /_templates/
Disallow: /_templates_c/
Disallow: /_test_reclama_contextuala_3/
Disallow: /_ticker/
Disallow: /_vaudio_p_r_o_t_e_c_t/
Disallow: /_video/
Disallow: /_video_p_r_o_t_e_c_t/
Disallow: /bursa_ro_transfer/
Disallow: /cgi-bin/
Disallow: /cautare/
Disallow: /client/
Disallow: /clienti/
Disallow: /clients/
Disallow: /clients_v1/
Disallow: /clients_v2/
Disallow: /forex-graph/
Disallow: /forex-graph_init/
Disallow: /resurse/
Disallow: /online/
Disallow: /ziar_online/
Disallow: /promotional/
Disallow: /serviciifinanciare/
Disallow: /tip_fed/
Disallow: /titluri/
Disallow: /top_titluri/
Disallow: /top_titluri_2/
Disallow: /top_titluri_3/
Disallow: /top_titluri2/
Disallow: /xopenx/

History

Changes recorded since June 2026.

No change recorded.

In context

Romania
12.7% block at least one AI crawler
Behind Cloudflare
No