model icon

Llama 3.2 3B Instruct

Q8_0

3.6Bparams
COMPARE ACCELERATORS

5 accelerators tested

Select Accelerators

AMD Radeon RX 6900 XT

16GB

AMD Ryzen 9 5950X 16-Core Processor (znver3)

125.7GB

AMD Ryzen 9 7940HS w/ Radeon 780M Graphics (znver4)

54.7GB

Intel Xeon CPU E5-2697 v2 @ 2.70GHz (ivybridge)

251.8GB

12th Gen Intel Core i5-12500T (alderlake)

15.3GB

Llama 3.2 3B Instruct - Q8_0

LEADERBOARD
PROMPT
2680
tokens/s
GENERATION
49.1
tokens/s
TTFT
603
ms
LOCALSCORE
602