CrawlerPulse
CrawlerPulse / Europe / Portugal / jn.pt

Jornal de Noticias

jn.pt · Portugal · NOTÍCIAS ILIMITADAS, S.A. · measured 8 Oct 2026

Google Search
Allowed
Google-Extended
Allowed
OpenAI
Blocked
Anthropic
Allowed
Perplexity
Allowed
Meta
Allowed
Common Crawl
Blocked
ByteDance
Allowed
Apple
Allowed
Amazon
Allowed

robots.txt

As read on 8 Oct 2026, 2,974 bytes. 4 rule groups name AI crawlers; shown first.

User-agent: GPTBot
Disallow: /

User-agent: CCBot
Disallow: /

User-agent: Google-Extended
Allow: /

User-agent: GPTBot
User-agent: Google-Extended
Allow: /apostas
Allow: /casino

Sitemap: https://www.jn.pt/feed/sitemap.xml
Sitemap: https://www.jn.pt/feed/news/sitemap.xml
Sitemap: https://www.jn.pt/feed/image/sitemap.xml
Sitemap: https://www.jn.pt/feed/video/sitemap.xml
Sitemap: https://www.jn.pt/feed/apostas/sitemap.xml
Sitemap: https://www.jn.pt/feed/casino/sitemap.xml

User-agent: *
Crawl-delay: 1
Allow: /*?page=
Disallow: /embed/
Disallow: /_next/
Disallow: /api/
Disallow: /*?utm_*
Disallow: /*?fbclid*
Disallow: /*?gclid*

User-agent: Googlebot
User-agent: Googlebot-News
User-agent: Googlebot-Video
User-agent: Googlebot-Image
User-agent: Bingbot
User-agent: Baiduspider
User-agent: Yandex
User-agent: YandexBot
User-agent: YandexMobileBot
User-agent: YandexVideo
User-agent: YandexWebmaster
User-agent: SeznamBot
Allow: /

User-agent: facebookexternalhit
User-agent: Facebot
User-agent: Twitterbot
User-agent: LinkedInBot
Allow: /

User-agent: AdsBot-Google
User-agent: Mediapartners-Google
Allow: /

User-agent: SemrushBot
User-agent: SemrushBot-SA
User-agent: AhrefsBot
User-agent: MJ12bot
User-agent: DotBot
User-agent: BLEXBot
User-agent: DataForSeoBot
Disallow: /

User-agent: ia_archiver
Allow: /

User-agent: ia_archiver-web.archive.org
Allow: /

User-agent: AhrefsBot
Allow: /apostas
Allow: /casino

History

Changes recorded since June 2026.

No change recorded.

In context

Portugal
28.8% block at least one AI crawler
Behind Cloudflare
No
Same group