CrawlerPulse
CrawlerPulse / Crawlers / Bytespider

Bytespider

ByteDance. ByteDance publishes no documentation for it; it is reported to collect content for ByteDance's products and AI models.

22.3%

of 12,650 measured news outlets block Bytespider.

Each square ≈ 127 outlets

By continent

Share of each continent's measured outlets blocking Bytespider.

Africa1,448
8%
Asia2,045
12%
Europe4,145
30%
Oceania341
28%

By country

Countries with 50 or more outlets measured, from the most blocking to the least.

Finland153
78%
Norway143
65%
Germany244
61%
Sweden178
56%
Italy222
43%
Canada199
38%
Ireland84
35%
Australia252
33%
Poland165
28%
France397
26%
Japan307
23%
Spain399
22%
Austria70
21%
Czechia71
20%
Denmark63
18%
India249
16%
Indonesia102
15%
Portugal104
14%
Ghana77
10%
Brazil283
9%
Mexico403
8%
Peru78
6%
Romania126
6%
Greece116
6%
China71
6%
Iran54
6%
Turkey101
5%
Cyprus61
5%
Argentina1,093
5%
Kenya106
5%
Nigeria226
4%
Ukraine145
4%
Serbia79
4%
Russia158
3%
Chile149
1%

Largest outlets that block Bytespider

By public reach. One cell per crawler.

Google SearchGoogle-ExtendedOpenAIAnthropicPerplexityMetaCommon CrawlByteDanceAppleAmazonof 9
facebook.com · Australia
3
endpoints.news · United States
5
nytimes.com · United States
8
t-online.de · Germany
7
medium.com · United States
6
theguardian.com · United Kingdom
7
cnn.com · United States
8
forbes.com · United States
8
bbc.com · Brazil
9
bbc.co.uk · United Kingdom
9
reuters.com · United States
9
washingtonpost.com · United States
7
bloomberg.com · United States
9
wsj.com · United States
7
espn.com · United States
4
businessinsider.com · United States
3
npr.org · United States
7
uol.com.br · Brazil
8
wired.com · United States
8
ft.com · United Kingdom
7
Google SearchGoogle-ExtendedOpenAIAnthropicPerplexityMetaCommon CrawlByteDanceAppleAmazonof 9
usatoday.com · United States
9
techcrunch.com · United States
6
elpais.com · Spain
5
lemonde.fr · France
6
dailymail.co.uk · United Kingdom
9
cnet.com · United States
8
bild.de · Germany
5
welt.de · Germany
5
people.com · United States
8
theverge.com · United States
7
nbcnews.com · United States
9
focus.de · Germany
6
latimes.com · United States
3
onet.pl · Poland
3
repubblica.it · Italy
6
theatlantic.com · United States
8
pbs.org · United States
4
ouest-france.fr · France
9
huffpost.com · United States
9
as.com · Spain
5
BlockedAllowed

Largest outlets that let it in

By public reach.

Google SearchGoogle-ExtendedOpenAIAnthropicPerplexityMetaCommon CrawlByteDanceAppleAmazonof 9
globo.com · Brazil
3
indiatimes.com · India
1
foxnews.com · United States
0
time.com · United States
0
telegraph.co.uk · United Kingdom
1
cbsnews.com · United States
1
independent.co.uk · United Kingdom
0
nikkei.com · Japan
0
apnews.com · United States
6
ameblo.jp · Japan
0
Google SearchGoogle-ExtendedOpenAIAnthropicPerplexityMetaCommon CrawlByteDanceAppleAmazonof 9
lefigaro.fr · France
5
elmundo.es · Spain
4
infobae.com · Argentina
0
n-tv.de · Germany
3
ameba.jp · Japan
0
goal.com · Japan
0
terra.com.br · Brazil
0
interia.pl · Poland
0
marca.com · Spain
4