Refact 1_6B Fim
Q4_K - Medium
1.6Bparams
COMPARE ACCELERATORS
1 accelerators tested
Select Accelerators
NVIDIA GeForce RTX 4050 Laptop GPU
6GB
Refact 1_6B Fim - Q4_K - Medium
LEADERBOARD
GPU / 6GB
PROMPT
3189
tokens/s
GENERATION
92.9
tokens/s
TTFT
512
ms
LOCALSCORE
833