Benchmark Explorer

Explore how models perform on various benchmarks

Benchmarks

Median Tokens/s

The median number of tokens processed per second, measuring the model's throughput in generating responses.
Source:

Model Performance

#1
131.0%
#2
129.9%
#4
115.5%
#5
111.7%
#6
86.3%
#7
86.3%
#8
85.0%
#9
84.3%
#14
71.5%
#19
61.2%
#20
58.4%
#21
57.6%
#22
55.0%
#25
50.8%
#26
49.5%
#27
46.8%
#28
39.1%
#30
37.1%
#31
36.7%
#32
34.9%
#34
33.5%
#35
32.6%
#37
31.1%
#38
28.7%
#39
27.4%
#40
26.3%
#41
25.9%
#44
23.3%
#45
23.2%
#46
22.4%
#47
22.2%
#49
21.2%
#50
20.9%
#51
18.1%
#52
17.1%
#53
15.7%
#55
11.1%
#56
9.8%
#57
9.7%
#59
0.0%
#62
0.0%
#63
0.0%
#64
0.0%
#65
0.0%
#66
0.0%
#67
0.0%