AMD Radeon RX 7800 XT
GPU
16
GB
PERFORMANCE OVERVIEW
Model
Llama-3.2-1B-Instruct
Q4_01.5B
Gemma 3 12b It
Q5_K - Medium12.8B
Qwen2.5 14B Instruct
Q4_K - Medium14.8B
Prompt Speed
2435tokens/s
385tokens/s
309tokens/s
Generation Speed
13.9tokens/s
6.5tokens/s
23.0tokens/s
Time to First Token
615ms
3.29sec
4.28sec
LocalScore
380
91
118
COMPARE MODELS
3 models tested
Select Models
Qwen2.5 14B Instruct
Q4_K - Medium
Gemma 3 12b It
Q5_K - Medium
Llama-3.2-1B-Instruct
Q4_0