logo
HomeLatest ResultsDownloadAboutBlog
model icon

Granite 3.3 8b Instruct

Q5_K - Medium

8.4Bparams
COMPARE ACCELERATORS

1 accelerators tested

Select Accelerators

Apple M4 Pro 10P+4E+20GPU

64GB

Granite 3.3 8b Instruct - Q5_K - Medium

LEADERBOARD
Apple M4 Pro 10P+4E+20GPU
GPU / 64GB
PROMPT
276
tokens/s
GENERATION
23.0
tokens/s
TTFT
4.45
sec
LOCALSCORE
113