CrawlerPulse
CrawlerPulse / Europe / Poland / nowiny24.pl

Nowiny24

nowiny24.pl · Poland · Polska Press Sp. z o.o. · measured 8 Oct 2026

Google Search
Allowed
Google-Extended
Blocked
OpenAI
Blocked
Anthropic
Blocked
Perplexity
Allowed
Meta
Blocked
Common Crawl
Blocked
ByteDance
Blocked
Apple
Blocked
Amazon
Blocked

robots.txt

As read on 8 Oct 2026, 1,928 bytes. 8 rule groups name AI crawlers; shown first.

User-agent: Amazonbot
Disallow: /

User-agent: Applebot-Extended
Disallow: /

User-agent: Bytespider
Disallow: /

User-agent: CCBot
Disallow: /

User-agent: ClaudeBot
Disallow: /

User-agent: Google-Extended
Disallow: /

User-agent: GPTBot
Disallow: /

User-agent: meta-externalagent
Disallow: /

User-agent: *
Content-Signal: search=yes,ai-train=no
Allow: /

User-agent: *
Disallow: /*?ses
Disallow: /_
Disallow: /ajax/*
Disallow: /onclick/*
Disallow: /.well-known/amphtml/apikey.pub
Disallow: /*link_label*
Disallow: /cdn-cgi/
Sitemap: https://nowiny24.pl/sitemapa/
Sitemap: https://nowiny24.pl/google_news/

History

Changes recorded since June 2026.

No change recorded.

In context