logo
HomeLatest ResultsDownloadAboutBlog
model icon

Gemma 3 4b It

Q6_K

4.6Bparams
COMPARE ACCELERATORS

3 accelerators tested

Select Accelerators

NVIDIA GeForce RTX 3060

12GB

NVIDIA GeForce RTX 2060

6GB

AMD Ryzen 7 4800H with Radeon Graphics (znver2)

30.8GB

Gemma 3 4b It - Q6_K

LEADERBOARD
NVIDIA GeForce RTX 3060
GPU / 12GB
PROMPT
1063
tokens/s
GENERATION
23.2
tokens/s
TTFT
1.70
sec
LOCALSCORE
244
NVIDIA GeForce RTX 2060
GPU / 6GB
PROMPT
716
tokens/s
GENERATION
24.9
tokens/s
TTFT
2.15
sec
LOCALSCORE
202