CrawlerPulse
CrawlerPulse / Europe / Italy / lapresse.it

La Presse.it

lapresse.it · Italy · La Presse Srl · measured 8 Oct 2026

Google Search
Partial
Google-Extended
Partial
OpenAI
Partial
Anthropic
Partial
Perplexity
Partial
Meta
Partial
Common Crawl
Partial
ByteDance
Partial
Apple
Partial
Amazon
Partial

robots.txt

As read on 8 Oct 2026, 2,518 bytes. No rule names an AI crawler.

sitemap: https://www.lapresse.it/sitemap-index.xml
sitemap: https://www.lapresse.it/sitemap-news.xml

User-agent: *
Disallow: /wp-admin/
Disallow: /accident/
Disallow: /actualite/
Disallow: /africa/
Disallow: /agriculture/
Disallow: /alimentaire/
Disallow: /americas-cup/
Disallow: /automobile/
Disallow: /aviation/
Disallow: /catastrophes/
Disallow: /china/
Disallow: /cinema-2/
Disallow: /climat/
Disallow: /conflit/
Disallow: /covid-19/
Disallow: /covid-19-us/
Disallow: /crime/
Disallow: /crisis-in-ukraine/
Disallow: /culture/
Disallow: /deces/
Disallow: /derniere-heure/
Disallow: /diplomatie/
Disallow: /divers/
Disallow: /drogue/
Disallow: /droits-de-lhomme/
Disallow: /eau/
Disallow: /ecole/
Disallow: /economie/
Disallow: /economy/
Disallow: /education/
Disallow: /energie/
Disallow: /enfance/
Disallow: /enseignement/
Disallow: /entertainment/
Disallow: /environnement/
Disallow: /espace/
Disallow: /etranger/
Disallow: /europe/
Disallow: /food/
Disallow: /genre/
Disallow: /green-us/
Disallow: /humanitaire/
Disallow: /italy/
Disallow: /jeunesse/
Disallow: /justice/
Disallow: /lifestyle/
Disallow: /maritime/
Disallow: /medias/
Disallow: /middle-east/
Disallow: /migrants/
Disallow: /migration/
Disallow: /militaire/
Disallow: /mobilite/
Disallow: /mode-2/
Disallow: /monde/
Disallow: /moteurs/
Disallow: /motors/
Disallow: /news/
Disallow: /nucleaire/
Disallow: /opinion/
Disallow: /parlement/
Disallow: /photos/
Disallow: /politics/
Disallow: /politique/
Disallow: /qatar-world-cup/
Disallow: /religion/
Disallow: /sante/
Disallow: /school-shooting/
Disallow: /sciences/
Disallow: /securite/
Disallow: /societe/
Disallow: /spectacles/
Disallow: /sports/
Disallow: /technologie/
Disallow: /technology/
Disallow: /terrorisme/
Disallow: /tourisme/
Disallow: /transport/
Disallow: /uncategorized-fr/
Disallow: /uncategorized-us/
Disallow: /u-s/
Disallow: /voyages/
Disallow: /world/
Allow: /wp-admin/admin-ajax.php

User-agent: msnbot
Crawl-delay: 10

User-agent: bingbot
Crawl-delay: 10

User-agent: Arianna
Disallow: /

User-agent: Arianna News
Disallow: /

User-agent: Arianna Web
Disallow: /

User-agent: Arianna Robot
Disallow: /

User-agent: Webnews Arianna
Disallow: /

User-agent: 360Spider
Disallow: /

User-agent: AhrefsBot
Disallow: /

User-agent: Sogouspider
Disallow: /

User-agent: Slurp
Disallow: /

User-agent: StackRambler
Disallow: /

User-agent: Yeti
Disallow: /

History

Changes recorded since June 2026.

2026-09-17Blocked → PartialGoogle-Extended

In context

Italy
54.5% block at least one AI crawler
Behind Cloudflare
No