CrawlerPulse
CrawlerPulse / Europe / Italy / giallozafferano.it

Giallozafferano.it

giallozafferano.it · Italy · Gruppo Mondadori · measured 8 Oct 2026

Google Search
Allowed
Google-Extended
Blocked
OpenAI
Blocked
Anthropic
Blocked
Perplexity
Blocked
Meta
Blocked
Common Crawl
Blocked
ByteDance
Blocked
Apple
Blocked
Amazon
Blocked

robots.txt

As read on 8 Oct 2026, 1,614 bytes. 12 rule groups name AI crawlers; shown first.

User-agent: Claude-Web
Disallow: /

User-agent: anthropic-ai
Disallow: /

User-agent: cohere-ai
Disallow: /

User-Agent: PerplexityBot
Disallow: /

User-agent: Amazonbot
Disallow: /

User-agent: Applebot-Extended
Disallow: /

User-agent: Bytespider
Disallow: /

User-agent: CCBot
Disallow: /

User-agent: ClaudeBot
Disallow: /

User-agent: Google-Extended
Disallow: /

User-agent: GPTBot
Disallow: /

User-agent: meta-externalagent
Disallow: /

User-agent: *
Allow: /
Disallow: /utility/
Disallow: /admin/
Disallow: /website/ricerca.php
Disallow: /ingredienti/
Disallow: /doubleclick/
Disallow: /4758/
Disallow: /Scuola-di-Cucina/
Disallow: /Guide-e-Consigli/
Disallow: /Guide-e-Consigli.html
Disallow: /website/
Disallow: /ingredienti-cat/
Disallow: /ricerca-blog/
Disallow: /ricerca-siti/
Disallow: /ricerca-ricette/no-index/*/
Disallow: /ricerca/
Disallow: /images/PDF/
Disallow: /static/regole_oro_content.js
Disallow: /*?preview=
Disallow: /search
Disallow: /ricette-con*/?
Disallow: /ricerca-ricette/*?
Disallow: /ricette-cat/*?
Disallow: /*/allcomments
Sitemap: https://www.giallozafferano.it/sitemap/ricerche.xml
Sitemap: https://www.giallozafferano.it/sitemap/portate.xml
Sitemap: https://www.giallozafferano.it/sitemap/articles.xml
Sitemap: https://www.giallozafferano.it/sitemap/speciali.xml
Sitemap: https://www.giallozafferano.it/sitemap/creators.xml
Sitemap: https://www.giallozafferano.it/sitemap/images.xml
Sitemap: https://www.giallozafferano.it/sitemap/christmas.xml

User-agent: seekr
Disallow: /

User-agent: Meltwater
Disallow: /

User-agent: CloudflareBrowserRenderingCrawler
Disallow: /

History

Changes recorded since June 2026.

No change recorded.

In context

Italy
54.5% block at least one AI crawler
Behind Cloudflare
Yes
Same group