logo
HomeLatest ResultsDownloadAboutBlog
model icon

Mistral Nemo Instruct 2407

Q8_0

12.2Bparams
COMPARE ACCELERATORS

3 accelerators tested

Select Accelerators

NVIDIA GeForce RTX 3080

20GB

AMD Radeon RX 6900 XT

16GB

AMD Ryzen 9 7940HS w/ Radeon 780M Graphics (znver4)

54.7GB

Mistral Nemo Instruct 2407 - Q8_0

LEADERBOARD
NVIDIA GeForce RTX 3080
GPU / 20GB
PROMPT
2044
tokens/s
GENERATION
44.0
tokens/s
TTFT
620
ms
LOCALSCORE
526
AMD Radeon RX 6900 XT
GPU / 16GB
PROMPT
832
tokens/s
GENERATION
20.7
tokens/s
TTFT
1.67
sec
LOCALSCORE
218