Intel Xeon CPU E5-2680 v4 @ 2.40GHz (broadwell)
CPU
125.8
GB
PERFORMANCE OVERVIEW
Model
Qwen2.5 14B Instruct
Q4_K - Medium14.8B
Prompt Speed
44tokens/s
Generation Speed
4.4tokens/s
Time to First Token
30.79sec
LocalScore
19
COMPARE MODELS
1 models tested
Select Models
Qwen2.5 14B Instruct
Q4_K - Medium