logo
HomeLatest ResultsDownloadAboutBlog
model icon

Mistral Nemo Instruct 2407

Q4_K - Medium

12.2Bparams
COMPARE ACCELERATORS

3 accelerators tested

Select Accelerators

NVIDIA RTX A5000

24GB

AMD Radeon RX 6900 XT

16GB

AMD Ryzen 9 7940HS w/ Radeon 780M Graphics (znver4)

54.7GB

Mistral Nemo Instruct 2407 - Q4_K - Medium

LEADERBOARD
NVIDIA RTX A5000
GPU / 24GB
PROMPT
1959
tokens/s
GENERATION
63.1
tokens/s
TTFT
650
ms
LOCALSCORE
575
AMD Radeon RX 6900 XT
GPU / 16GB
PROMPT
746
tokens/s
GENERATION
27.1
tokens/s
TTFT
1.90
sec
LOCALSCORE
220