TEST #1803 RESULTS

11/15/2025 - 10:01 PM

21.0

tokens/s

generation

5.89

sec

time to first token

207

tokens/s

prompt

90

LocalScore

HOW YOU STACK UP
Explore All Results

Qwen2.5 14B Instruct - Q4_K - Medium

SYSTEM
CPU
Apple M1 Max 8P+2E
RAM
64GB
OS
Darwin
Kernel Release
25.1.0
Architecture
arm64
Version
Cosmopolitan 3.9.7 MODE=aarch64; Darwin Kernel Version 25.1.0: Mon Oct 20 19:32:41 PDT 2025; root:xnu-12377.41.6~2/RELEASE_ARM64_T6000
RUNTIME
Name
llamafile
Version
0.9.2
Commit Hash
a30b324
DETAILED RESULTS
TEST NAME
PROMPT
GENERATION
TTFT
pp1024+tg16
237
tokens/s
22.9
tokens/s
4.37
sec
pp4096+tg256
222
tokens/s
16.4
tokens/s
18.52
sec
pp2048+tg256
231
tokens/s
20.0
tokens/s
8.90
sec
pp2048+tg768
232
tokens/s
19.5
tokens/s
8.88
sec
pp1024+tg1024
236
tokens/s
21.5
tokens/s
4.38
sec
pp1280+tg3072
233
tokens/s
18.8
tokens/s
5.53
sec
pp384+tg1152
227
tokens/s
22.8
tokens/s
1.73
sec
pp64+tg1024
178
tokens/s
23.9
tokens/s
399
ms
pp16+tg1536
63
tokens/s
23.4
tokens/s
294
ms