NVIDIA GeForce GTX 1070
GPU
8
GB
PERFORMANCE OVERVIEW
Model
Llama 3.2 1B Instruct
Q4_K - Medium1.5B
qwen2.5-3b-instruct
Q4_K - Medium3.4B
Prompt Speed
2547tokens/s
1090tokens/s
Generation Speed
102tokens/s
49.4tokens/s
Time to First Token
512ms
1.19sec
LocalScore
799
356
COMPARE MODELS
2 models tested
Select Models
Llama 3.2 1B Instruct
Q4_K - Medium
qwen2.5-3b-instruct
Q4_K - Medium
