Gemma 3 1b It
Q4_K - Medium
1.3Bparams
COMPARE ACCELERATORS
7 accelerators tested
Select Accelerators
NVIDIA GeForce RTX 3090
24GB
NVIDIA GeForce RTX 4050 Laptop GPU
6GB
NVIDIA GeForce GTX 1080 Ti
11GB
NVIDIA GeForce RTX 3060 Laptop GPU
6GB
AMD Radeon RX 6650 XT
8GB
Gemma 3 1b It - Q4_K - Medium
LEADERBOARD
GPU / 6GB
PROMPT
8007
tokens/s
GENERATION
87.0
tokens/s
TTFT
161
ms
LOCALSCORE
1628
GPU / 6GB
PROMPT
6477
tokens/s
GENERATION
73.8
tokens/s
TTFT
190
ms
LOCALSCORE
1359