logo
HomeLatest ResultsDownloadAboutBlog
model icon

Granite 3.2 8b Instruct

Q4_K - Medium

8.4Bparams
COMPARE ACCELERATORS

1 accelerators tested

Select Accelerators

Apple M1 Max 8P+2E+32GPU

64GB

Granite 3.2 8b Instruct - Q4_K - Medium

LEADERBOARD
Apple M1 Max 8P+2E+32GPU
GPU / 64GB
PROMPT
332
tokens/s
GENERATION
32.6
tokens/s
TTFT
3.64
sec
LOCALSCORE
144