logo
HomeLatest ResultsDownloadAboutBlog
model icon

Gemma 3 12b It

Q3_K - Large

12.8Bparams
COMPARE ACCELERATORS

1 accelerators tested

Select Accelerators

NVIDIA GeForce RTX 4070

12GB

Gemma 3 12b It - Q3_K - Large

LEADERBOARD
NVIDIA GeForce RTX 4070
GPU / 12GB
PROMPT
1540
tokens/s
GENERATION
36.7
tokens/s
TTFT
2.59
sec
LOCALSCORE
279