Benchmark Explorer

Explore how models perform on various benchmarks

Benchmarks

Median Tokens/s

The median number of tokens processed per second, measuring the model's throughput in generating responses.
Source:

Model Performance

#1
253.0
#5
214.0
#6
210.0
#7
209.0
#8
191.0
#9
191.0
#10
185.0
#11
163.0
#12
143.1
#14
135.0
#16
127.0
#19
123.0
#23
116.8
#24
116.0
#27
95.0
#28
93.6
#29
91.0
#30
85.0
#31
82.0
#32
81.0
#33
78.0
#34
78.0
#38
74.0
#39
72.0
#41
68.0
#42
66.0
#43
66.0
#44
64.0
#45
60.0
#46
57.0
#47
54.0
#48
53.0
#51
51.0
#52
49.0
#55
48.0
#57
46.0
#59
45.0
#64
43.0
#65
41.0
#67
40.0
#68
39.0
#69
39.0
#73
32.0
#74
32.0
#75
32.0
#76
30.0
#77
12.0
#78
0.0
#80
0.0
#82
0.0
#86
0.0
#87
0.0
#90
0.0
#92
0.0
#96
0.0
#97
0.0
#98
0.0
#100
0.0
#101
0.0