TEST #400 RESULTS
04/06/2025 - 5:42 PM
ACCELERATOR
MODEL
68.1
tokens/s
generation
115
ms
time to first token
11064
tokens/s
prompt
1873
LocalScore
HOW YOU STACK UP
Explore All ResultsModel Hf - Q8_0
SYSTEM
CPU
AMD Ryzen 5 5600X 6-Core Processor (znver3)
RAM
63.9GB
OS
Windows
Kernel Release
10.0
Architecture
x86_64
Version
Cosmopolitan 3.9.7 MODE=x86_64
RUNTIME
Name
llamafile
Version
0.9.2
Commit Hash
a30b324
DETAILED RESULTS
TEST NAME
PROMPT
GENERATION
TTFT
pp1024+tg16
13977
tokens/s
63.7
tokens/s
90
ms
pp4096+tg256
13896
tokens/s
65.8
tokens/s
308
ms
pp2048+tg256
13282
tokens/s
65.5
tokens/s
169
ms
pp2048+tg768
15046
tokens/s
68.7
tokens/s
150
ms
pp1024+tg1024
13365
tokens/s
69.3
tokens/s
92
ms
pp1280+tg3072
14580
tokens/s
68.6
tokens/s
103
ms
pp384+tg1152
11861
tokens/s
69.9
tokens/s
48
ms
pp64+tg1024
2877
tokens/s
71.1
tokens/s
36
ms
pp16+tg1536
693
tokens/s
70.4
tokens/s
37
ms