pap.pl · Poland · PAP (Polish Press Agency) · measured 8 Oct 2026
As read on 8 Oct 2026, 1,402 bytes. 1 rule group name AI crawlers; shown first.
User-agent: GPTBot User-agent: ChatGPT-User User-agent: OAI-SearchBot User-agent: CCBot User-agent: ClaudeBot User-agent: Claude-SearchBot User-agent: Claude-User User-agent: Bytespider User-agent: PerplexityBot User-agent: Perplexity-User User-agent: Google-CloudVertexBot User-agent: Meta-ExternalAgent User-agent: Meta-ExternalFetcher User-agent: FacebookBot User-agent: Amazonbot User-agent: PetalBot User-agent: MistralAI-User User-agent: DuckAssistBot User-agent: Timpibot User-agent: Novellum AI Crawl User-agent: ProRataInc Allow: /mediaroom$ Allow: /mediaroom/ Disallow: / User-agent: * Disallow: /*?page=* Disallow: /aktualnosci/index* Disallow: /wyszukiwanie/ Disallow: /en/search/ Disallow: /core/ Disallow: /profiles/ Disallow: /node/ Disallow: /en/node/ Disallow: /en/search/ Disallow: /en/taxonomy/ Disallow: /ru/news/ Disallow: /ru/node/ Disallow: /ru/search/ Disallow: /ru/taxonomy/ Disallow: /ua/news/ Disallow: /ua/node/ Disallow: /ua/search/ Disallow: /ua/taxonomy/ Disallow: /pap_external_news/ Disallow: /taxonomy/ Disallow: /README.txt Disallow: /web.config Disallow: /admin/ Disallow: /comment/ Disallow: /filter/ Disallow: /search/ Disallow: /user/ Disallow: /media/oembed Disallow: /*/media/oembed Disallow: /index.php/
Changes recorded since June 2026.
No change recorded.