CrawlerPulse
CrawlerPulse / Europe / Poland / naszemiasto.pl

Naszemiasto

naszemiasto.pl · Poland · Polska Press Sp. z o.o. · measured 8 Oct 2026

Google Search
Allowed
Google-Extended
Blocked
OpenAI
Blocked
Anthropic
Blocked
Perplexity
Allowed
Meta
Blocked
Common Crawl
Blocked
ByteDance
Blocked
Apple
Blocked
Amazon
Blocked

robots.txt

As read on 8 Oct 2026, 2,031 bytes. 8 rule groups name AI crawlers; shown first.

User-agent: Amazonbot
Disallow: /

User-agent: Applebot-Extended
Disallow: /

User-agent: Bytespider
Disallow: /

User-agent: CCBot
Disallow: /

User-agent: ClaudeBot
Disallow: /

User-agent: Google-Extended
Disallow: /

User-agent: GPTBot
Disallow: /

User-agent: meta-externalagent
Disallow: /

User-agent: *
Content-Signal: search=yes,ai-train=no
Allow: /

User-agent: *
Disallow: /*?ses
Disallow: /_
Disallow: /drukuj/
Disallow: /ajax/*
Disallow: /firma/*.html
Disallow: /cdn-cgi/
Disallow: /mm-trendy-dziewczyna-w-puszczy/gh/c13-3753051/2
Disallow: /oswiecim-anna-gawelek-potrzebuje-pieniedzy-by-zwalczyc/ar/c15-8781619
Sitemap: https://naszemiasto.pl/sitemapa/
Sitemap: https://naszemiasto.pl/google_news/

History

Changes recorded since June 2026.

No change recorded.

In context