AMD Radeon RX 7800 XT
GPU
16
GB
PERFORMANCE OVERVIEW
Model
Gemma 3 12b It
Q5_K - Medium12.8B
Qwen2.5 14B Instruct
Q4_K - Medium14.8B
Prompt Speed
385tokens/s
316tokens/s
Generation Speed
6.5tokens/s
23.0tokens/s
Time to First Token
3.29sec
4.22sec
LocalScore
91
120
COMPARE MODELS
2 models tested
Select Models
Qwen2.5 14B Instruct
Q4_K - Medium
Gemma 3 12b It
Q5_K - Medium