CrawlerPulse
CrawlerPulse / Crawlers / GPTBot

GPTBot

OpenAI. Collects public web content that may be used to train OpenAI's generative AI models. OpenAI's documentation.

25.2%

of 12,650 measured news outlets block GPTBot.

Each square ≈ 127 outlets

By continent

Share of each continent's measured outlets blocking GPTBot.

Africa1,448
8%
Asia2,045
14%
Europe4,145
36%
Oceania341
25%

By country

Countries with 50 or more outlets measured, from the most blocking to the least.

Finland153
78%
Germany244
69%
Denmark63
67%
Norway143
63%
Sweden178
57%
Ireland84
55%
Italy222
45%
Canada199
44%
France397
38%
Poland165
32%
Spain399
30%
Japan307
30%
Austria70
29%
Australia252
28%
Portugal104
27%
Indonesia102
27%
Czechia71
20%
India249
16%
Brazil283
11%
Greece116
11%
Turkey101
11%
Colombia194
10%
Ghana77
9%
Romania126
9%
Peru78
8%
Mexico403
7%
China71
7%
Cyprus61
7%
Nigeria226
6%
Russia158
6%
Iran54
6%
Argentina1,093
5%
Ukraine145
4%
Kenya106
4%
Chile149
3%
Serbia79
3%

Largest outlets that block GPTBot

By public reach. One cell per crawler.

Google SearchGoogle-ExtendedOpenAIAnthropicPerplexityMetaCommon CrawlByteDanceAppleAmazonof 9
endpoints.news · United States
5
nytimes.com · United States
8
t-online.de · Germany
7
medium.com · United States
6
cnn.com · United States
8
forbes.com · United States
8
bbc.com · Brazil
9
bbc.co.uk · United Kingdom
9
reuters.com · United States
9
bloomberg.com · United States
9
globo.com · Brazil
3
espn.com · United States
4
npr.org · United States
7
usatoday.com · United States
9
techcrunch.com · United States
6
cbsnews.com · United States
1
dailymail.co.uk · United Kingdom
9
cnet.com · United States
8
apnews.com · United States
6
lefigaro.fr · France
5
Google SearchGoogle-ExtendedOpenAIAnthropicPerplexityMetaCommon CrawlByteDanceAppleAmazonof 9
nbcnews.com · United States
9
focus.de · Germany
6
latimes.com · United States
3
repubblica.it · Italy
6
elmundo.es · Spain
4
n-tv.de · Germany
3
pbs.org · United States
4
ouest-france.fr · France
9
huffpost.com · United States
9
bfmtv.com · France
9
marca.com · Spain
4
skysports.com · United Kingdom
2
economist.com · United Kingdom
7
cbc.ca · Canada
3
elconfidencial.com · Spain
9
theconversation.com · Australia
9
gazzetta.it · Italy
7
merkur.de · Germany
8
abc.net.au · Australia
7
ladepeche.fr · France
7
BlockedAllowed

Largest outlets that let it in

By public reach.

Google SearchGoogle-ExtendedOpenAIAnthropicPerplexityMetaCommon CrawlByteDanceAppleAmazonof 9
facebook.com · Australia
3
theguardian.com · United Kingdom
7
washingtonpost.com · United States
7
wsj.com · United States
7
businessinsider.com · United States
3
indiatimes.com · India
1
foxnews.com · United States
0
uol.com.br · Brazil
8
wired.com · United States
8
ft.com · United Kingdom
7
Google SearchGoogle-ExtendedOpenAIAnthropicPerplexityMetaCommon CrawlByteDanceAppleAmazonof 9
time.com · United States
0
telegraph.co.uk · United Kingdom
1
elpais.com · Spain
5
lemonde.fr · France
6
independent.co.uk · United Kingdom
0
bild.de · Germany
5
nikkei.com · Japan
0
welt.de · Germany
5
ameblo.jp · Japan
0
people.com · United States
8