logo
HomeLatest ResultsDownloadAboutBlog
model icon

Llama 3.2 3B Instruct

Q3_K - Large

3.6Bparams
COMPARE ACCELERATORS

2 accelerators tested

Select Accelerators

AMD Radeon RX 9070 XT

16GB

AMD Ryzen 9 5950X 16-Core Processor (znver3)

62.7GB

Llama 3.2 3B Instruct - Q3_K - Large

LEADERBOARD
AMD Radeon RX 9070 XT
GPU / 16GB
PROMPT
1033
tokens/s
GENERATION
81.0
tokens/s
TTFT
1.22
sec
LOCALSCORE
409