CrawlerPulse
CrawlerPulse / Europe / Portugal / lusa.pt

Agencia LUSA

lusa.pt · Portugal · Lusa Agência de Notícias de Portugal, SA · measured 8 Oct 2026

Google Search
Allowed
Google-Extended
Partial
OpenAI
Blocked
Anthropic
Partial
Perplexity
Partial
Meta
Partial
Common Crawl
Partial
ByteDance
Partial
Apple
Partial
Amazon
Partial

robots.txt

As read on 8 Oct 2026, 2,171 bytes. 3 rule groups name AI crawlers; shown first.

User-agent: ChatGPT-User
Disallow: /

User-agent: GPTBot
Disallow: /

User-agent: FacebookBot
Crawl-delay: 120
Disallow: /Admin/
Disallow: /App_Code/
Disallow: /App_Data/
Disallow: /bin/
Disallow: /Content/
Disallow: /logs/
Disallow: /styles/
Disallow: /Scripts/
Disallow: /Portal/
Disallow: /Handlers/
Allow: /national
Allow: /economia
Allow: /culture
Allow: /desporto
Allow: /international
Allow: /lusofonia
Allow: /lusanews
Allow: /newsletters
Allow: /about-lusa
Allow: /contact-us
Allow: /video-gallery
Allow: /image-gallery
Allow: /article/

User-agent: Googlebot-Bard
Disallow: /

User-agent: OpenAI-Crawler
Disallow: /

User-agent: Googlebot
Crawl-delay: 120
Disallow: /Admin/
Disallow: /App_Code/
Disallow: /App_Data/
Disallow: /bin/
Disallow: /Content/
Disallow: /logs/
Disallow: /styles/
Disallow: /Scripts/
Disallow: /Portal/
Disallow: /Handlers/
Allow: /national
Allow: /economia
Allow: /culture
Allow: /desporto
Allow: /international
Allow: /lusofonia
Allow: /lusanews
Allow: /newsletters
Allow: /about-lusa
Allow: /contact-us
Allow: /video-gallery
Allow: /image-gallery
Allow: /article/

User-agent: Twitterbot
Crawl-delay: 120
Disallow: /Admin/
Disallow: /App_Code/
Disallow: /App_Data/
Disallow: /bin/
Disallow: /Content/
Disallow: /logs/
Disallow: /styles/
Disallow: /Scripts/
Disallow: /Portal/
Disallow: /Handlers/
Allow: /national
Allow: /economia
Allow: /culture
Allow: /desporto
Allow: /international
Allow: /lusofonia
Allow: /lusanews
Allow: /newsletters
Allow: /about-lusa
Allow: /contact-us
Allow: /video-gallery
Allow: /image-gallery
Allow: /article/

User-agent: *
Crawl-delay: 120
Disallow: /Admin/
Disallow: /App_Code/
Disallow: /App_Data/
Disallow: /bin/
Disallow: /Content/
Disallow: /logs/
Disallow: /styles/
Disallow: /Scripts/
Disallow: /Portal/
Disallow: /Handlers/
Disallow: /article/
Allow: /national
Allow: /economia
Allow: /culture
Allow: /desporto
Allow: /international
Allow: /lusofonia
Allow: /lusanews
Allow: /newsletters
Allow: /about-lusa
Allow: /contact-us
Allow: /video-gallery
Allow: /image-gallery

History

Changes recorded since June 2026.

No change recorded.

In context

Portugal
28.8% block at least one AI crawler
Behind Cloudflare
Yes