NVIDIA GeForce GTX 1660
GPU
6
GB
PERFORMANCE OVERVIEW
Model
Llama 3.2 1B Instruct
Q4_K - Medium1.5B
Phi 4 Mini Instruct
Q4_K - Medium4.5B
Meta Llama 3.1 8B Instruct
Q4_K - Medium8.0B
Prompt Speed
765tokens/s
244tokens/s
129tokens/s
Generation Speed
34.2tokens/s
17.0tokens/s
9.0tokens/s
Time to First Token
1.85sec
5.97sec
10.99sec
LocalScore
242
89
47
COMPARE MODELS
4 models tested
Select Models
Llama 3.2 1B Instruct
Q4_K - Medium
Meta Llama 3.1 8B Instruct
Q4_K - Medium
Phi 4 Mini Instruct
Q4_K - Medium
Hf_Model
Q4_K - Medium