logo
HomeLatest ResultsDownloadAboutBlog
model icon

Gemma 3 12b It Qat

Q4_0

12.8Bparams
COMPARE ACCELERATORS

1 accelerators tested

Select Accelerators

NVIDIA GeForce RTX 3060

12GB

Gemma 3 12b It Qat - Q4_0

LEADERBOARD
NVIDIA GeForce RTX 3060
GPU / 12GB
PROMPT
1075
tokens/s
GENERATION
30.4
tokens/s
TTFT
1.18
sec
LOCALSCORE
303