Qwen2.5 0.5B Instruct
Q4_K - Medium
630Mparams
COMPARE ACCELERATORS
2 accelerators tested
Select Accelerators
NVIDIA GeForce GTX 1060 3GB
3GB
NVIDIA GeForce GTX 1660 SUPER
6GB
Qwen2.5 0.5B Instruct - Q4_K - Medium
LEADERBOARD
GPU / 6GB
PROMPT
1515
tokens/s
GENERATION
63.9
tokens/s
TTFT
936
ms
LOCALSCORE
469