Qwen2.5 Coder 14B Instruct AWQ
Q4_K - Medium
14.8Bparams
COMPARE ACCELERATORS
1 accelerators tested
Select Accelerators
NVIDIA GeForce RTX 2080 Ti
11GB
Qwen2.5 Coder 14B Instruct AWQ - Q4_K - Medium
LEADERBOARD
GPU / 11GB
PROMPT
1133
tokens/s
GENERATION
35.9
tokens/s
TTFT
1.10
sec
LOCALSCORE
333