CrawlerPulse
CrawlerPulse / Europe / Luxembourg / zlv.lu

Zeitung vum Letzebuerger Vollek

zlv.lu · Luxembourg · measured 8 Oct 2026

Google Search
Allowed
Google-Extended
Allowed
OpenAI
Blocked
Anthropic
Allowed
Perplexity
Allowed
Meta
Allowed
Common Crawl
Allowed
ByteDance
Allowed
Apple
Allowed
Amazon
Allowed

robots.txt

As read on 8 Oct 2026, 1,193 bytes. 2 rule groups name AI crawlers; shown first.

User-agent: GPTBot
Disallow: /

User-agent: PetalBot
Disallow: /

User-agent: Twitterbot
Disallow:

User-agent: *
Crawl-delay: 10
Sitemap: https://www.zlv.lu/sitemap.xml
Disallow: /cgi-bin/apps/base
Disallow: /base
Disallow: /db
Allow: /db/1/
Disallow: /cgi-bin/apps/storyboard
Disallow: /storyboard
Disallow: /cgi-bin/apps/tiparlo
Disallow: /tiparlo
Disallow: /babbelix
Disallow: /cgi-bin/apps/wiki
Disallow: /wiki
Disallow: /cgi-bin/apps/wikiview
Disallow: /wikiview
Disallow: /cgi-bin/apps/wikiinfo
Disallow: /wikiinfo
Disallow: /cgi-bin/apps/wikilayout
Disallow: /wikilayout
Disallow: /cgi-bin/apps/wikipages
Disallow: /wikipages
Disallow: /cgi-bin/apps/wikitools
Disallow: /wikitools
Disallow: /cgi-bin/apps/webbook
Disallow: /webbook
Disallow: /cgi-bin/apps/poll
Disallow: /poll
Disallow: /cgi-bin/apps/timeline
Disallow: /timeline
Disallow: /cgi-bin/apps/olefacalendar
Disallow: /olefacalendar
Disallow: /calendar
Disallow: /cgi-bin/apps/resources
Disallow: /cgi-bin/apps/resourcesfile
Disallow: /resourcesfile
Disallow: /cgi-bin/apps/browse
Disallow: /browse
Disallow: /cgi-bin/apps/gallery
Disallow: /gallery
Disallow: /*mode=print*
Disallow: /*search_*=*
Disallow: /osr/templates

History

Changes recorded since June 2026.

No change recorded.

In context

Luxembourg
23.8% block at least one AI crawler
Behind Cloudflare
No