model icon

Llama 3.2 3B Instruct

Q4_K - Small

3.6Bparams
COMPARE ACCELERATORS

1 accelerators tested

Select Accelerators

AMD Radeon RX 7800 XT

16GB

Llama 3.2 3B Instruct - Q4_K - Small

LEADERBOARD
PROMPT
1203
tokens/s
GENERATION
57.1
tokens/s
TTFT
1.13
sec
LOCALSCORE
394