model icon

Mistral-7B-Instruct-v0.3

Q4_K - Medium

7.2Bparams
COMPARE ACCELERATORS

1 accelerators tested

Select Accelerators

NVIDIA GeForce GTX 1060 6GB

6GB

Mistral-7B-Instruct-v0.3 - Q4_K - Medium

LEADERBOARD
PROMPT
336
tokens/s
GENERATION
17.9
tokens/s
TTFT
3.96
sec
LOCALSCORE
115