ordis_v355_VarGH_merged
Q4_K - Medium
1.8Bparams
COMPARE ACCELERATORS
1 accelerators tested
Select Accelerators
NVIDIA GeForce RTX 4050 Laptop GPU
6GB
ordis_v355_VarGH_merged - Q4_K - Medium
LEADERBOARD
GPU / 6GB
PROMPT
4816
tokens/s
GENERATION
92.8
tokens/s
TTFT
287
ms
LOCALSCORE
1159