logo
HomeLatest ResultsDownloadAboutBlog
model icon

Qwen2.5.1 Coder 7B Instruct

Q4_K - Medium

7.6Bparams
COMPARE ACCELERATORS

2 accelerators tested

Select Accelerators

NVIDIA GeForce RTX 2080 Ti

11GB

AMD Radeon RX 6650 XT

8GB

Qwen2.5.1 Coder 7B Instruct - Q4_K - Medium

LEADERBOARD
NVIDIA GeForce RTX 2080 Ti
GPU / 11GB
PROMPT
2355
tokens/s
GENERATION
68.0
tokens/s
TTFT
523
ms
LOCALSCORE
674
AMD Radeon RX 6650 XT
GPU / 8GB
PROMPT
566
tokens/s
GENERATION
26.8
tokens/s
TTFT
2.58
sec
LOCALSCORE
180