TEST #3574 RESULTS

05/19/2026 - 2:04 PM

33.6

tokens/s

generation

3.10

sec

time to first token

377

tokens/s

prompt

160

LocalScore

HOW YOU STACK UP
Explore All Results

Qwen2.5 14B Instruct - Q4_K - Medium

SYSTEM
CPU
Apple M2 Ultra 16P+8E
RAM
128GB
OS
Darwin
Kernel Release
25.4.0
Architecture
arm64
Version
Cosmopolitan 3.9.7 MODE=aarch64; Darwin Kernel Version 25.4.0: Thu Mar 19 19:31:17 PDT 2026; root:xnu-12377.101.15~1/RELEASE_ARM64_T6020
RUNTIME
Name
llamafile
Version
0.9.2
Commit Hash
a30b324
DETAILED RESULTS
TEST NAME
PROMPT
GENERATION
TTFT
pp1024+tg16
448
tokens/s
36.3
tokens/s
2.31
sec
pp4096+tg256
428
tokens/s
26.0
tokens/s
9.61
sec
pp2048+tg256
445
tokens/s
31.9
tokens/s
4.63
sec
pp2048+tg768
444
tokens/s
30.9
tokens/s
4.65
sec
pp1024+tg1024
446
tokens/s
34.3
tokens/s
2.32
sec
pp1280+tg3072
439
tokens/s
29.7
tokens/s
2.95
sec
pp384+tg1152
420
tokens/s
36.8
tokens/s
940
ms
pp64+tg1024
240
tokens/s
38.8
tokens/s
290
ms
pp16+tg1536
80
tokens/s
37.6
tokens/s
223
ms