model icon

Qwen2.5 Coder 14B Instruct AWQ

Q4_0

14.8Bparams
COMPARE ACCELERATORS

1 accelerators tested

Select Accelerators

NVIDIA GeForce RTX 2080 Ti

11GB

Qwen2.5 Coder 14B Instruct AWQ - Q4_0

LEADERBOARD
PROMPT
1254
tokens/s
GENERATION
37.9
tokens/s
TTFT
994
ms
LOCALSCORE
363