logo
HomeLatest ResultsDownloadAboutBlog
model icon

qwen2.5-3b-instruct

Q4_0

3.4Bparams
COMPARE ACCELERATORS

1 accelerators tested

Select Accelerators

NVIDIA GeForce GTX 1660 Ti

6GB

qwen2.5-3b-instruct - Q4_0

LEADERBOARD
NVIDIA GeForce GTX 1660 Ti
GPU / 6GB
PROMPT
306
tokens/s
GENERATION
20.1
tokens/s
TTFT
4.66
sec
LOCALSCORE
110