Qwen3 1.7B
Q4_K - Medium
2.0Bparams
COMPARE ACCELERATORS
2 accelerators tested
Select Accelerators
NVIDIA GeForce RTX 4050 Laptop GPU
6GB
NVIDIA GeForce GTX 1060 6GB
6GB
Qwen3 1.7B - Q4_K - Medium
LEADERBOARD
GPU / 6GB
PROMPT
3512
tokens/s
GENERATION
91.0
tokens/s
TTFT
400
ms
LOCALSCORE
928
GPU / 6GB
PROMPT
1000
tokens/s
GENERATION
51.0
tokens/s
TTFT
1.43
sec
LOCALSCORE
329