Accelerator icon
NVIDIA GeForce GTX 1070
GPU
8
GB
PERFORMANCE OVERVIEW
Model
Llama 3.2 1B Instruct
Q4_K - Medium1.5B
qwen2.5-3b-instruct
Q4_K - Medium3.4B
Prompt Speed
2547tokens/s
1090tokens/s
Generation Speed
102tokens/s
49.4tokens/s
Time to First Token
512ms
1.19sec
LocalScore
799
356
COMPARE MODELS

2 models tested

Select Models

Llama 3.2 1B Instruct

Q4_K - Medium

qwen2.5-3b-instruct

Q4_K - Medium

NVIDIA GeForce GTX 1070 - 8GB