NVIDIA GeForce GTX 1660 Ti
GPU
6
GB
PERFORMANCE OVERVIEW
Model
Raincandy U TinyStories 656K
Q2_K - Medium1M
qwen2.5-3b-instruct
Q4_03.4B
Prompt Speed
40879tokens/s
306tokens/s
Generation Speed
563tokens/s
20.1tokens/s
Time to First Token
38ms
4.66sec
LocalScore
8484
110
COMPARE MODELS
2 models tested
Select Models
Raincandy U TinyStories 656K
Q2_K - Medium
qwen2.5-3b-instruct
Q4_0