Qwen2 96M
Q4_K - Medium
96Mparams
COMPARE ACCELERATORS
3 accelerators tested
Select Accelerators
NVIDIA GeForce RTX 4050 Laptop GPU
6GB
Intel Core i5-14450HX (alderlake)
15.7GB
Intel Celeron CPU N3350 @ 1.10GHz
3.6GB
Qwen2 96M - Q4_K - Medium
LEADERBOARD
GPU / 6GB
PROMPT
19873
tokens/s
GENERATION
234
tokens/s
TTFT
85
ms
LOCALSCORE
3795