model icon

Qwen2.5 Coder 7B Instruct

Q6_K

7.6Bparams
COMPARE ACCELERATORS

1 accelerators tested

Select Accelerators

NVIDIA GeForce RTX 2080 Ti

11GB

Qwen2.5 Coder 7B Instruct - Q6_K

LEADERBOARD
PROMPT
2148
tokens/s
GENERATION
57.9
tokens/s
TTFT
564
ms
LOCALSCORE
604