AMD Radeon RX 5700 XT
GPU
8
GB
PERFORMANCE OVERVIEW
Model
Granite 3.1 1b A400M Instruct
F161.4B
Meta Llama 3.1 8B Instruct
Q4_K - Medium8.0B
Prompt Speed
1297tokens/s
256tokens/s
Generation Speed
27.4tokens/s
25.4tokens/s
Time to First Token
911ms
5.68sec
LocalScore
339
105
COMPARE MODELS
2 models tested
Select Models
Meta Llama 3.1 8B Instruct
Q4_K - Medium
Granite 3.1 1b A400M Instruct
F16