logo
HomeLatest ResultsDownloadAboutBlog
model icon

Qwen2.5.1 Coder 7B Instruct

Q6_K

7.6Bparams
COMPARE ACCELERATORS

2 accelerators tested

Select Accelerators

NVIDIA GeForce RTX 2080 Ti

11GB

AMD Radeon RX 6600 XT

8GB

Qwen2.5.1 Coder 7B Instruct - Q6_K

LEADERBOARD
NVIDIA GeForce RTX 2080 Ti
GPU / 11GB
PROMPT
2136
tokens/s
GENERATION
57.1
tokens/s
TTFT
568
ms
LOCALSCORE
599
AMD Radeon RX 6600 XT
GPU / 8GB
PROMPT
507
tokens/s
GENERATION
23.0
tokens/s
TTFT
2.82
sec
LOCALSCORE
161