AMD Ryzen 9 9950X3D2 16-Core Processor
CPU
60.5
GB
PERFORMANCE OVERVIEW
Model
Meta Llama 3.1 8B Instruct
Q4_K - Medium8.0B
Qwen2.5 14B Instruct
Q4_K - Medium14.8B
Prompt Speed
251tokens/s
129tokens/s
Generation Speed
12.2tokens/s
6.7tokens/s
Time to First Token
5.44sec
10.68sec
LocalScore
83
43
COMPARE MODELS
2 models tested
Select Models
Meta Llama 3.1 8B Instruct
Q4_K - Medium
Qwen2.5 14B Instruct
Q4_K - Medium