Gemma 3 12b It
Q4_K - Medium
12.8Bparams
COMPARE ACCELERATORS
2 accelerators tested
Select Accelerators
NVIDIA RTX A5000 Laptop GPU
16GB
AMD Ryzen 7 4800H with Radeon Graphics (znver2)
30.8GB
Gemma 3 12b It - Q4_K - Medium
LEADERBOARD
GPU / 16GB
PROMPT
1027
tokens/s
GENERATION
29.2
tokens/s
TTFT
1.26
sec
LOCALSCORE
288