logo
HomeLatest ResultsDownloadAboutBlog
model icon

Mistral Small 24B Instruct 2501

Q4_K - Small

23.6Bparams
COMPARE ACCELERATORS

1 accelerators tested

Select Accelerators

Apple M4 Max 10P+4E+32GPU

36GB

Mistral Small 24B Instruct 2501 - Q4_K - Small

LEADERBOARD
Apple M4 Max 10P+4E+32GPU
GPU / 36GB
PROMPT
185
tokens/s
GENERATION
21.3
tokens/s
TTFT
6.74
sec
LOCALSCORE
84