model icon

Llama 3.2 3B Instruct

Q6_K

3.6Bparams
COMPARE ACCELERATORS

4 accelerators tested

Select Accelerators

AMD Radeon RX 6900 XT

16GB

NVIDIA GeForce GTX 1060 6GB

6GB

AMD Ryzen 9 5950X 16-Core Processor (znver3)

125.7GB

AMD Ryzen 9 7940HS w/ Radeon 780M Graphics (znver4)

54.7GB

Llama 3.2 3B Instruct - Q6_K

LEADERBOARD
PROMPT
2124
tokens/s
GENERATION
52.8
tokens/s
TTFT
713
ms
LOCALSCORE
540
PROMPT
682
tokens/s
GENERATION
27.9
tokens/s
TTFT
1.95
sec
LOCALSCORE
214