ilgazzettino.it · Italy · Ced Digital & Servizi s.r.l. · measured 8 Oct 2026
As read on 8 Oct 2026, 2,866 bytes. 17 rule groups name AI crawlers; shown first.
User-agent: GPTBot Disallow: / User-agent: Google-Extended Disallow: / User-agent: anthropic-ai Disallow: / User-agent: CCBot Disallow: / User-agent: Omgilibot Disallow: / User-agent: cohere-ai Disallow: / User-agent: ChatGPT-User Disallow: / User-agent: OAI-SearchBot Disallow: / User-agent: PerplexityBot Disallow: / User-agent: Amazonbot Disallow: / User-agent: YouBot Disallow: / User-agent: Claude-Web Disallow: / User-agent: Claudebot Disallow: / User-agent: Diffbot Disallow: / User-agent: Bytespider Disallow: / User-agent: ImagesiftBot Disallow: / User-agent: Petalbot Disallow: / User-agent: * Sitemap: http://www.ilgazzettino.it/?sez=XML&p=MapNews Disallow: /cache/ Disallow: /includes/ Disallow: /query_cache/ Disallow: /cgi-bin/ Disallow: *sez=JSON* Disallow: *sez=AJAX* Disallow: /view.php* Disallow: /view* Disallow: /ELEZIONI2014 Disallow: /ANSAviewnews2.php* Disallow: /ANSAviewnews.php* Disallow: /articolo.php* Disallow: /articoloins.php Disallow: /articolo_app.php Disallow: /tag.php* Disallow: /ricerca.php* Disallow: /aprifoto.php* Disallow: /articolo_app.php* Disallow: /mobile/* Disallow: /foto.php* Disallow: /fotogallery.php* Disallow: /video.php* Disallow: /sondaggio.php* Disallow: /*.aspx Disallow: *p=flashnews* Disallow: /twitter_share.php Disallow: /box_tuttomercato/index_tm.php Disallow: /casa/* Disallow: /box_ajax* Disallow: /dump_database.php?db=all Disallow: /admin_login.php Disallow: /sicurezza_stradale* Disallow: /dettaglio.php* Disallow: /box_pl* Disallow: /diretta_europei.php* Disallow: /mobile/ Disallow: /38681514/ Disallow: /flashnews/ Disallow: *p=all_news* Disallow: *?p=search* Disallow: /native_* Disallow: /speciale_eni-joule.html Disallow: /ultimissime_adn/* Disallow: /XXXleggitutte* Disallow: /u/* Disallow: /index.php/* Disallow: /sport/stats/* Disallow: /megapress/* Disallow: /?p=single_module* Disallow: /index.php?p=single_module* Disallow: /index.php?p=single_module_owl* Disallow: /*track_shop_event.php* Disallow: /track_shop_event.php* Disallow: /monitor.php Disallow: /video/askanews/* Disallow: /video/adnkronos/* Disallow: *?p=informazioni_legali Disallow: /ricerca/* Disallow: /ansa_press_release* Disallow: /modules/next_articles/* User-agent: uMBot Disallow: / User-Agent: uMBot-LN Disallow: / User-Agent: uMBot-IC Disallow: / User-agent: Arianna Crawl-delay: 5 User-agent: Arianna News Crawl-delay: 5 User-agent: Arianna Web Crawl-delay: 5 User-agent: Arianna Robot Crawl-delay: 5 User-agent: Claude-User Disallow: / User-agent: Claude-SearchBot Disallow: / User-agent: Meltwater Disallow: / User-agent: Seekr Disallow: / User-agent: Applebot Disallow: / User-agent: DuckAssistBot Disallow: /
Changes recorded since June 2026.
No change recorded.