CrawlerPulse
CrawlerPulse / Europe / Italy / wallstreetitalia.com

wallstreetitalia.com

wallstreetitalia.com · Italy · measured 8 Oct 2026

Google Search
Allowed
Google-Extended
Allowed
OpenAI
Allowed
Anthropic
Allowed
Perplexity
Allowed
Meta
Allowed
Common Crawl
Allowed
ByteDance
Allowed
Apple
Allowed
Amazon
Allowed

robots.txt

As read on 8 Oct 2026, 2,624 bytes. 2 rule groups name AI crawlers; shown first.

User-agent: GPTBot
Crawl-delay: 1
Disallow: /caso-banca-marche-richiesta-di-rettifica-riceviamo-e-pubblichiamo/
Disallow: /madoff-dei-parioli-ecco-la-lista-con-i-nomi-truffati-evasori-o-tutt-e-due/
Disallow: /private-banking-in-ordine-sparso-alla-ricerca-della-redditivita/
Disallow: /terremoto-alla-banca-del-vaticano-dimissioni-al-vertice-ior/
Disallow: /arresto-mons-scarano-sequestri-a-tappeto-nello-ior/
Disallow: /a-fondo-perduto/
Disallow: /furbetti-del-quartierino-tre-anni-a-bille-e-porreca-per-corruzione/
Disallow: /unaltra-truffa-ai-danni-dei-risparmiatori-italiani/
Disallow: /truffa-fondo-finex-spuntano-nomi-responsabili/
Disallow: /il-mondo-chiude-una-buona-notizia-per-chi-si-occupa-di-economia-e-mercati/
Disallow: /un-filo-rosso-lega-bipop-alla-lodi/
Disallow: /scandalo-fazio-nuove-telefonate/
Disallow: /banca-marche-il-sistema-di-corruzione-di-cui-bankitalia-era-al-corrente/
Disallow: /ecco-i-tremonti-boys/
Disallow: /ops-class-editori-gambero-rosso-uno-scambio-da-cogliere/
Disallow: /litaliano-che-ha-beffato-piu-volte-maggiori-banche/
Disallow: /crack-pellicano-i-500-000-euro-nascosti-nei-tubi-di-casa/
Disallow: /vergogna-italiana-150-milioni-di-tasse-rubate-finite-in-bond-finti-e-pazze-spese/
Disallow: /unicredit-e-bnl-erogati-mutui-ai-boss-senza-alcuna-garanzia/
Disallow: /la-rai-compra-film-per-poi-non-trasmetterli-1-2-miliardi-in-9-anni/
Disallow: /sergio-rizzo-e-l-italia-fondata-sul-conflitto-d-interesse/
Disallow: /cashback-come-evitare-brutte-sorprese/
Disallow: /telecom-br-debiti-e-spie/
Disallow: /coronavirus-ecco-quando-finira-il-lockdown-nei-singoli-paesi/
Disallow: /triboo-fornira-174-milioni-di-mascherine-chirurgiche-al-commissario-arcuri/
Disallow: /mps-mussari-come-craxi-accolto-da-insulti-e-lanciodi-monetine/
Disallow: /malinconico-si-dimette-risolto-primo-scandalo-per-il-governo-monti/
Disallow: /ue-vieta-esportazioni-sistemi-hi-tech-in-siria-area-spa-se-ne-va/
Disallow: /le-nuove-lobby-italiane-trinitvicina-a-renzi/
Disallow: /arrestato-per-bancarotta-perna-imprenditore-d-alta-moda/

User-agent: GPTBot
Crawl-delay: 1
Sitemap: https://www.wallstreetitalia.com/sitemap_index.xml
Sitemap: https://www.wallstreetitalia.com/google_news-sitemap.xml
Sitemap: https://www.wallstreetitalia.com/video-sitemap.xml

User-agent: *
Disallow: /wp/wp-admin/
Disallow: /readme.html
Allow: /wp/wp-admin/admin-ajax.php
Allow: /app/
Disallow: /?s=
Disallow: *redirect_to*

History

Changes recorded since June 2026.

No change recorded.

In context

Italy
54.5% block at least one AI crawler
Behind Cloudflare
Yes