logo
HomeLatest ResultsDownloadAboutBlog
model icon

Ministral 8B Instruct 2410 TEST

Q6_K

8.0Bparams
COMPARE ACCELERATORS

1 accelerators tested

Select Accelerators

NVIDIA GeForce RTX 4070 Ti

12GB

Ministral 8B Instruct 2410 TEST - Q6_K

LEADERBOARD
NVIDIA GeForce RTX 4070 Ti
GPU / 12GB
PROMPT
3200
tokens/s
GENERATION
54.2
tokens/s
TTFT
421
ms
LOCALSCORE
744