logo
HomeLatest ResultsDownloadAboutBlog
model icon

Llama 3.2 1B Instruct

Q5_K - Medium

1.5Bparams
COMPARE ACCELERATORS

6 accelerators tested

Select Accelerators

AMD Radeon RX 6900 XT

16GB

Apple M1 Pro 8P+2E+16GPU

32GB

Apple M2 4P+4E+8GPU

8GB

AMD Ryzen 9 5950X 16-Core Processor (znver3)

125.7GB

AMD Ryzen 9 7940HS w/ Radeon 780M Graphics (znver4)

54.7GB

Llama 3.2 1B Instruct - Q5_K - Medium

LEADERBOARD
AMD Radeon RX 6900 XT
GPU / 16GB
PROMPT
5591
tokens/s
GENERATION
110
tokens/s
TTFT
281
ms
LOCALSCORE
1299
Apple M1 Pro 8P+2E+16GPU
GPU / 32GB
PROMPT
1079
tokens/s
GENERATION
66.8
tokens/s
TTFT
1.11
sec
LOCALSCORE
402
Apple M2 4P+4E+8GPU
GPU / 8GB
PROMPT
662
tokens/s
GENERATION
43.5
tokens/s
TTFT
1.97
sec
LOCALSCORE
245