CrawlerPulse
CrawlerPulse / Europe / Poland / zycie.pl

Zycie Podkarpackie

zycie.pl · Poland · measured 8 Oct 2026

Google Search
Allowed
Google-Extended
Blocked
OpenAI
Blocked
Anthropic
Allowed
Perplexity
Allowed
Meta
Allowed
Common Crawl
Blocked
ByteDance
Allowed
Apple
Allowed
Amazon
Blocked

robots.txt

As read on 8 Oct 2026, 2,022 bytes. 6 rule groups name AI crawlers; shown first.

User-agent: CCBot
Disallow: /

User-agent: GPTBot
Disallow: /

User-agent: ChatGPT-User
Disallow: /

User-agent: Omgilibot
Disallow: /

User-agent: Google-Extended
Disallow: /
Disallow: /regulamin

User-agent: Amazonbot
Disallow: /

User-agent: *
Disallow: /adserver
Disallow: /polityka_prywatnosci
Disallow: /regulamin_reklamy
Disallow: /zdjecie-ogloszenia/
Disallow: /zdjecie-firma/
Disallow: /grupa/
Disallow: /pwa
Disallow: /pwa/
Disallow: /cdn-cgi
Disallow: /cdn-cgi/
Disallow: /abuse-news/
Disallow: /abuse-forum/
Disallow: /dodajkomentarz/
Disallow: /dodajpost/
Disallow: /cytujpost/
Disallow: /user/
Disallow: /22894967496/
Disallow: /ax-galeria/

User-agent: img2dataset
Disallow: /

User-agent: Yandex
Disallow: /

User-agent: YandexBot
Disallow: /

User-agent: moget
User-agent: ichiro
Disallow: /

User-agent: MauiBot
Disallow: /

User-agent: NaverBot
User-agent: Yeti
Disallow: /

User-agent: Baiduspider
User-agent: baiduspider
User-agent: Baiduspider+
User-agent: Baiduspider-video
User-agent: Baiduspider-image
Disallow: /

User-agent: sogou spider
Disallow: /

User-agent: YoudaoBot
Disallow: /

User-Agent: MJ12bot
Disallow: /

User-Agent: majesticseo
Disallow: /

User-Agent: Slurp
Disallow: /

User-Agent: Buck
Disallow: /

User-agent: SemrushBot
Disallow: /

User-agent: Yahoo! Slurp
Disallow: /

User-agent: Cliqzbot
Disallow: /

User-agent: SEOkicks-Robot
Disallow: /

User-agent: NPBot
Disallow: /

User-agent: BLEXBot
Disallow: /

User-agent: grapeshot
Disallow: /

User-agent: oBot
Disallow: /

User-agent: MegaIndex.ru
Disallow: /

User-agent: magpie-crawler
Disallow: /

User-Agent: trendictionbot
Disallow: /

User-Agent: sentibot
Disallow: /

User-Agent: DomainStatsBot
Disallow: /

User-agent: msnbot
Crawl-delay: 10

User-agent: bingbot
Crawl-delay: 10

User-agent: LCC
Disallow: /

User-agent: spbot
Disallow: /

User-agent: Barkrowler
Disallow: /

User-agent: VelenPublicWebCrawler
Disallow: /

User-agent: Mediapartners-Google
Disallow:
Sitemap: https://zycie.pl/sitemap.xml

History

Changes recorded since June 2026.

No change recorded.

In context

Poland
36.4% block at least one AI crawler
Behind Cloudflare
Yes