logo
HomeLatest ResultsDownloadAboutBlog
model icon

Gemma 3 27b

Q4_0

28.4Bparams
COMPARE ACCELERATORS

2 accelerators tested

Select Accelerators

Quadro RTX 6000

24GB

NVIDIA GB10

120GB

Gemma 3 27b - Q4_0

LEADERBOARD
Quadro RTX 6000
GPU / 24GB
PROMPT
647
tokens/s
GENERATION
22.0
tokens/s
TTFT
1.95
sec
LOCALSCORE
194
NVIDIA GB10
GPU / 120GB
PROMPT
676
tokens/s
GENERATION
10.4
tokens/s
TTFT
1.90
sec
LOCALSCORE
155