logo
HomeLatest ResultsDownloadAboutBlog
model icon

Mistral Small 24B Instruct 2501

Q4_K - Medium

23.6Bparams
COMPARE ACCELERATORS

1 accelerators tested

Select Accelerators

NVIDIA RTX A5000

24GB

Mistral Small 24B Instruct 2501 - Q4_K - Medium

LEADERBOARD
NVIDIA RTX A5000
GPU / 24GB
PROMPT
1116
tokens/s
GENERATION
38.8
tokens/s
TTFT
1.12
sec
LOCALSCORE
338