logo
HomeLatest ResultsDownloadAboutBlog
model icon

Mistral Small 22B ArliAI RPMax v1.1

Q5_K - Medium

22.2Bparams
COMPARE ACCELERATORS

1 accelerators tested

Select Accelerators

NVIDIA GeForce RTX 2060

12GB

Mistral Small 22B ArliAI RPMax v1.1 - Q5_K - Medium

LEADERBOARD
NVIDIA GeForce RTX 2060
GPU / 12GB
PROMPT
110
tokens/s
GENERATION
2.0
tokens/s
TTFT
16.03
sec
LOCALSCORE
24