NVIDIA GeForce GTX 1660 SUPER
GPU
6
GB
PERFORMANCE OVERVIEW
Model
Llama 3.2 1B Instruct
Q4_K - Medium1.5B
Llama 3.2 3B Instruct
Q4_K - Medium3.6B
Meta Llama 3.1 8B Instruct
Q4_K - Medium8.0B
Prompt Speed
800tokens/s
293tokens/s
129tokens/s
Generation Speed
35.6tokens/s
14.4tokens/s
9.6tokens/s
Time to First Token
1.81sec
4.99sec
10.93sec
LocalScore
251
95
48
COMPARE MODELS
12 models tested
Select Models
Llama 3.2 1B Instruct
Q4_K - Medium
Meta Llama 3.1 8B Instruct
Q4_K - Medium
Llama 3.2 3B Instruct
Q4_K - Medium
Qwen2.5 Coder 7B Instruct
Q4_K - Medium
Qwen2.5 0.5B Instruct
Q4_K - Medium