CrawlerPulse
CrawlerPulse / Europe / Lithuania / respublika.lt

Respublika

respublika.lt · Lithuania · measured 9 Oct 2026

Google Search
Allowed
Google-Extended
Blocked
OpenAI
Blocked
Anthropic
Blocked
Perplexity
Allowed
Meta
Blocked
Common Crawl
Blocked
ByteDance
Blocked
Apple
Blocked
Amazon
Allowed

robots.txt

As read on 9 Oct 2026, 915 bytes. 8 rule groups name AI crawlers; shown first.

User-agent: GPTBot
Disallow: /

User-agent: ClaudeBot
Disallow: /

User-agent: Google-Extended
Disallow: /

User-agent: CCBot
Disallow: /

User-agent: Meta-ExternalAgent
Disallow: /

User-agent: FacebookBot
Disallow: /

User-agent: Bytespider
Disallow: /

User-agent: Applebot-Extended
Disallow: /

User-agent: facebookexternalhit
Allow: /

User-agent: *
Disallow: /banners/
Disallow: /cache/
Disallow: *,archyvas.*
Disallow: *,coments.*
Disallow: *,filter.*
Disallow: *,html.*
Disallow: *,key.*
Disallow: *,offset.*
Disallow: *,order.*
Disallow: *print=*
Allow: /
Allow: /*/naujienos/,offset.*
Allow: /*/naujienos/*/*/*amp.*
Sitemap: https://www.respublika.lt/sitemaps/sitemaps.xml

History

Changes recorded since June 2026.

No change recorded.

In context

Lithuania
16.7% block at least one AI crawler
Behind Cloudflare
No