logo
HomeLatest ResultsDownloadAboutBlog
model icon

Amoral Gemma3 12B

Q4_K - Medium

12.8Bparams
COMPARE ACCELERATORS

2 accelerators tested

Select Accelerators

NVIDIA GeForce RTX 4060 Ti

16GB

NVIDIA GeForce RTX 3060

12GB

Amoral Gemma3 12B - Q4_K - Medium

LEADERBOARD
NVIDIA GeForce RTX 4060 Ti
GPU / 16GB
PROMPT
1582
tokens/s
GENERATION
26.9
tokens/s
TTFT
824
ms
LOCALSCORE
373
NVIDIA GeForce RTX 3060
GPU / 12GB
PROMPT
1004
tokens/s
GENERATION
29.5
tokens/s
TTFT
1.27
sec
LOCALSCORE
286