Accelerator icon
NVIDIA GeForce GTX 1060 6GB
GPU
6
GB
PERFORMANCE OVERVIEW
Model
Llama 3.2 1B Instruct
Q4_K - Medium1.5B
DeepSeek R1 Distill Qwen 1.5B
Q4_K - Medium1.8B
DeepSeek R1 Distill Qwen 7B
Q4_K - Medium7.6B
Prompt Speed
1796tokens/s
1475tokens/s
365tokens/s
Generation Speed
72.6tokens/s
62.5tokens/s
19.1tokens/s
Time to First Token
741ms
897ms
3.53sec
LocalScore
560
468
125
COMPARE MODELS

14 models tested

Select Models

Llama 3.2 1B Instruct

Q4_K - Medium

DeepSeek R1 Distill Qwen 1.5B

Q4_K - Medium

DeepSeek R1 Distill Qwen 7B

Q4_K - Medium

Llama 3.2 1B Instruct

Q8_0

Llama 3.2 3B Instruct

Q6_K

NVIDIA GeForce GTX 1060 6GB - 6GB