Accelerator icon
AMD Radeon 780M Graphics
GPU
28
GB
PERFORMANCE OVERVIEW
Model
Meta Llama 3.1 8B Instruct
Q4_K - Medium8.0B
Qwen2.5 14B Instruct
Q4_K - Medium14.8B
Prompt Speed
186tokens/s
99tokens/s
Generation Speed
5.6tokens/s
3.1tokens/s
Time to First Token
7.06sec
13.29sec
LocalScore
53
28
COMPARE MODELS

2 models tested

Select Models

Meta Llama 3.1 8B Instruct

Q4_K - Medium

Qwen2.5 14B Instruct

Q4_K - Medium

AMD Radeon 780M Graphics - 28GB