NVIDIA GeForce GTX 1060 6GB
GPU
6
GB
PERFORMANCE OVERVIEW
Model
Llama 3.2 1B Instruct
Q4_K - Medium1.5B
DeepSeek R1 Distill Qwen 1.5B
Q4_K - Medium1.8B
DeepSeek R1 Distill Qwen 7B
Q4_K - Medium7.6B
Prompt Speed
1863tokens/s
1475tokens/s
365tokens/s
Generation Speed
76.9tokens/s
62.5tokens/s
19.1tokens/s
Time to First Token
722ms
897ms
3.53sec
LocalScore
583
468
125
COMPARE MODELS
13 models tested
Select Models
Llama 3.2 1B Instruct
Q4_K - Medium
DeepSeek R1 Distill Qwen 1.5B
Q4_K - Medium
DeepSeek R1 Distill Qwen 7B
Q4_K - Medium
Llama 3.2 1B Instruct
Q8_0
Llama 3.2 3B Instruct
Q6_K