logo
HomeLatest ResultsDownloadAboutBlog
model icon

EuroLLM 9B Instruct

Q4_K - Medium

9.2Bparams
COMPARE ACCELERATORS

1 accelerators tested

Select Accelerators

NVIDIA GeForce RTX 3090

24GB

EuroLLM 9B Instruct - Q4_K - Medium

LEADERBOARD
NVIDIA GeForce RTX 3090
GPU / 24GB
PROMPT
2827
tokens/s
GENERATION
83.9
tokens/s
TTFT
455
ms
LOCALSCORE
805