Rio 3.0 Open Mini
Q4_K - Medium
4.4Bparams
COMPARE ACCELERATORS
1 accelerators tested
Select Accelerators
NVIDIA GeForce RTX 4050 Laptop GPU
6GB
Rio 3.0 Open Mini - Q4_K - Medium
LEADERBOARD
GPU / 6GB
PROMPT
1785
tokens/s
GENERATION
45.8
tokens/s
TTFT
827
ms
LOCALSCORE
462