logo
HomeLatest ResultsDownloadAboutBlog
model icon

Qwen2.5 Coder 14B Instruct AWQ

Q8_0

14.8Bparams
COMPARE ACCELERATORS

1 accelerators tested

Select Accelerators

NVIDIA GeForce RTX 2080 Ti

11GB

Qwen2.5 Coder 14B Instruct AWQ - Q8_0

LEADERBOARD
NVIDIA GeForce RTX 2080 Ti
GPU / 11GB
PROMPT
137
tokens/s
GENERATION
2.2
tokens/s
TTFT
12.35
sec
LOCALSCORE
29