AMD Radeon RX 6600 XT
GPU
8
GB
PERFORMANCE OVERVIEW
Model
Qwen2.5.1 Coder 7B Instruct
Q6_K7.6B
Meta Llama 3.1 8B Instruct
Q4_K - Medium8.0B
Deepseek-R1-0528-Qwen3-8B
Q6_K8.2B
Prompt Speed
507tokens/s
604tokens/s
432tokens/s
Generation Speed
23.0tokens/s
21.5tokens/s
18.3tokens/s
Time to First Token
2.82sec
2.34sec
3.79sec
LocalScore
161
177
128
COMPARE MODELS
7 models tested
Select Models
Meta Llama 3.1 8B Instruct
Q4_K - Medium
Qwen2.5.1 Coder 7B Instruct
Q6_K
Deepseek-R1-0528-Qwen3-8B
Q6_K
Qwen3 4B Instruct 2507
Q4_K - Medium
Gemma 3 Finetune
Q8_0