logo
HomeLatest ResultsDownloadAboutBlog
model icon

Llama 3.2 1B Instruct

Q8_0

1.5Bparams
COMPARE ACCELERATORS

7 accelerators tested

Select Accelerators

AMD Radeon RX 6900 XT

16GB

AMD Radeon RX 7800 XT

16GB

NVIDIA GeForce GTX 1060 6GB

6GB

AMD Ryzen 9 5950X 16-Core Processor (znver3)

125.7GB

AMD Ryzen 9 7940HS w/ Radeon 780M Graphics (znver4)

54.7GB

Llama 3.2 1B Instruct - Q8_0

LEADERBOARD
AMD Radeon RX 6900 XT
GPU / 16GB
PROMPT
6338
tokens/s
GENERATION
103
tokens/s
TTFT
259
ms
LOCALSCORE
1359
AMD Radeon RX 7800 XT
GPU / 16GB
PROMPT
3073
tokens/s
GENERATION
105
tokens/s
TTFT
445
ms
LOCALSCORE
898
NVIDIA GeForce GTX 1060 6GB
GPU / 6GB
PROMPT
1921
tokens/s
GENERATION
66.8
tokens/s
TTFT
710
ms
LOCALSCORE
565