model icon

Qwen1.5-0.5B-Chat-AWQ-fp16

Q4_K - Medium

620Mparams
COMPARE ACCELERATORS

1 accelerators tested

Select Accelerators

NVIDIA GeForce RTX 5070 Ti

15GB

Qwen1.5-0.5B-Chat-AWQ-fp16 - Q4_K - Medium

LEADERBOARD
PROMPT
16250
tokens/s
GENERATION
172
tokens/s
TTFT
90
ms
LOCALSCORE
3143