active
Q2_K - Medium
1.1Bparams
COMPARE ACCELERATORS
1 accelerators tested
Select Accelerators
NVIDIA GeForce RTX 3060 Laptop GPU
6GB
active - Q2_K - Medium
LEADERBOARD
GPU / 6GB
PROMPT
3954
tokens/s
GENERATION
106
tokens/s
TTFT
350
ms
LOCALSCORE
1061