logo
HomeLatest ResultsDownloadAboutBlog
model icon

Llama-3.2-1B-Instruct

Q4_0

1.5Bparams
COMPARE ACCELERATORS

2 accelerators tested

Select Accelerators

Radeon RX 7900 XTX

24GB

AMD Radeon RX 7800 XT

16GB

Llama-3.2-1B-Instruct - Q4_0

LEADERBOARD
Radeon RX 7900 XTX
GPU / 24GB
PROMPT
3681
tokens/s
GENERATION
16.6
tokens/s
TTFT
418
ms
LOCALSCORE
527
AMD Radeon RX 7800 XT
GPU / 16GB
PROMPT
2435
tokens/s
GENERATION
13.9
tokens/s
TTFT
615
ms
LOCALSCORE
380