NVIDIA GeForce GTX 1660 Ti
GPU
6
GB
PERFORMANCE OVERVIEW
Model
Raincandy U TinyStories 656K
Q2_K - Medium1M
Llama 3.2 1B Instruct
Q4_K - Medium1.5B
qwen2.5-3b-instruct
Q4_03.4B
Prompt Speed
40879tokens/s
829tokens/s
306tokens/s
Generation Speed
563tokens/s
37.1tokens/s
20.1tokens/s
Time to First Token
38ms
1.67sec
4.66sec
LocalScore
8484
264
110
COMPARE MODELS
3 models tested
Select Models
Llama 3.2 1B Instruct
Q4_K - Medium
Raincandy U TinyStories 656K
Q2_K - Medium
qwen2.5-3b-instruct
Q4_0