Home
Latest Results
Download
About
Blog
gemma2
Q8_0
10.2B
params
COMPARE ACCELERATORS
1 accelerators tested
Select Accelerators
NVIDIA GeForce RTX 4060 Ti
16GB
gemma2 - Q8_0
Prompt tokens/s
Generation tokens/s
Time to First Token (ms)
LocalScore
LEADERBOARD
GPU
CPU+GPU
CPU
ACCELERATOR
PROMPT
GENERATION
TTFT
LOCALSCORE
NVIDIA GeForce RTX 4060 Ti
GPU / 16GB
PROMPT
1787
tokens/s
GENERATION
21.9
tokens/s
TTFT
770
ms
LOCALSCORE
371
