model icon

Qwen2.5 Coder 7B Instruct GGUF

Q4_K - Medium

7.6Bparams
COMPARE ACCELERATORS

1 accelerators tested

Select Accelerators

NVIDIA GeForce RTX 2080 Ti

11GB

Qwen2.5 Coder 7B Instruct GGUF - Q4_K - Medium

LEADERBOARD
PROMPT
2355
tokens/s
GENERATION
68.2
tokens/s
TTFT
522
ms
LOCALSCORE
675