Gemma-3-12B-It
Q4_K - Medium
12.8Bparams
COMPARE ACCELERATORS
1 accelerators tested
Select Accelerators
NVIDIA GeForce RTX 4080 SUPER
16GB
Gemma-3-12B-It - Q4_K - Medium
LEADERBOARD
GPU / 16GB
PROMPT
3159
tokens/s
GENERATION
39.1
tokens/s
TTFT
402
ms
LOCALSCORE
675