Qwen1.5-0.5B-Chat-AWQ-fp16
Q8_0
620Mparams
COMPARE ACCELERATORS
1 accelerators tested
Select Accelerators
NVIDIA GeForce GTX 1660 SUPER
6GB
Qwen1.5-0.5B-Chat-AWQ-fp16 - Q8_0
LEADERBOARD
GPU / 6GB
PROMPT
1795
tokens/s
GENERATION
63.1
tokens/s
TTFT
841
ms
LOCALSCORE
513