logo
HomeLatest ResultsDownloadAboutBlog
model icon

Gemma 3 4b It Qat

Q4_0

4.6Bparams
COMPARE ACCELERATORS

2 accelerators tested

Select Accelerators

NVIDIA GeForce RTX 4060 Ti

16GB

NVIDIA GeForce RTX 3060

12GB

Gemma 3 4b It Qat - Q4_0

LEADERBOARD
NVIDIA GeForce RTX 4060 Ti
GPU / 16GB
PROMPT
4859
tokens/s
GENERATION
63.0
tokens/s
TTFT
264
ms
LOCALSCORE
1050
NVIDIA GeForce RTX 3060
GPU / 12GB
PROMPT
2981
tokens/s
GENERATION
65.1
tokens/s
TTFT
419
ms
LOCALSCORE
774