Home
Latest Results
Download
About
Blog
Gemma 3 Finetune
Q8_0
4.6B
params
COMPARE ACCELERATORS
1 accelerators tested
Select Accelerators
AMD Radeon RX 6600 XT
8GB
Gemma 3 Finetune - Q8_0
Prompt tokens/s
Generation tokens/s
Time to First Token (ms)
LocalScore
LEADERBOARD
GPU
CPU+GPU
CPU
ACCELERATOR
PROMPT
GENERATION
TTFT
LOCALSCORE
AMD Radeon RX 6600 XT
GPU / 8GB
PROMPT
1181
tokens/s
GENERATION
24.6
tokens/s
TTFT
1.31
sec
LOCALSCORE
281
