Google. Not a separate crawler but a robots.txt token: it lets a site opt out of its content training future Gemini models and grounding Gemini answers, without affecting Google Search. Google's documentation.
of 12,650 measured news outlets block Google-Extended.
Share of each continent's measured outlets blocking Google-Extended.
Countries with 50 or more outlets measured, from the most blocking to the least.
By public reach. One cell per crawler.
By public reach.