Qwen2.5 Coder 7B Instruct
Q4_K - Medium
7.6Bparams
COMPARE ACCELERATORS
2 accelerators tested
Select Accelerators
NVIDIA GeForce RTX 2060
6GB
NVIDIA GeForce GTX 1660 SUPER
6GB
Qwen2.5 Coder 7B Instruct - Q4_K - Medium
LEADERBOARD
GPU / 6GB
PROMPT
145
tokens/s
GENERATION
15.7
tokens/s
TTFT
9.56
sec
LOCALSCORE
62