logo
HomeLatest ResultsDownloadAboutBlog
model icon

Qwen2.5 1.5B Instruct

Q6_K

1.8Bparams
COMPARE ACCELERATORS

1 accelerators tested

Select Accelerators

NVIDIA GeForce RTX 3090

24GB

Qwen2.5 1.5B Instruct - Q6_K

LEADERBOARD
NVIDIA GeForce RTX 3090
GPU / 24GB
PROMPT
11228
tokens/s
GENERATION
205
tokens/s
TTFT
111
ms
LOCALSCORE
2746