Home
Latest Results
Download
About
Blog
gemma-2b-it
Q4_0
3.0B
params
COMPARE ACCELERATORS
1 accelerators tested
Select Accelerators
NVIDIA GeForce GTX 1060 6GB
6GB
gemma-2b-it - Q4_0
Prompt tokens/s
Generation tokens/s
Time to First Token (ms)
LocalScore
LEADERBOARD
GPU
CPU+GPU
CPU
ACCELERATOR
PROMPT
GENERATION
TTFT
LOCALSCORE
NVIDIA GeForce GTX 1060 6GB
GPU / 6GB
PROMPT
1304
tokens/s
GENERATION
59.1
tokens/s
TTFT
989
ms
LOCALSCORE
427
