logo
HomeLatest ResultsDownloadAboutBlog
model icon

Qwen2.5 7B Instruct

Q4_K - Medium

7.6Bparams
COMPARE ACCELERATORS

1 accelerators tested

Select Accelerators

AMD Radeon RX 7800 XT

16GB

Qwen2.5 7B Instruct - Q4_K - Medium

LEADERBOARD
AMD Radeon RX 7800 XT
GPU / 16GB
PROMPT
659
tokens/s
GENERATION
44.1
tokens/s
TTFT
1.96
sec
LOCALSCORE
246