Intel Xeon CPU E5-2470 v2 @ 2.40GHz (ivybridge)
CPU
94.2
GB
PERFORMANCE OVERVIEW
Model
Llama 3.2 1B Instruct
Q4_K - Medium1.5B
Prompt Speed
43tokens/s
Generation Speed
17.4tokens/s
Time to First Token
31.70sec
LocalScore
29
COMPARE MODELS
1 models tested
Select Models
Llama 3.2 1B Instruct
Q4_K - Medium