logo
HomeLatest ResultsDownloadAboutBlog
model icon

DeepSeek R1 Distill Llama 8B

Q4_K - Medium

8.0Bparams
COMPARE ACCELERATORS

3 accelerators tested

Select Accelerators

NVIDIA GeForce RTX 2080 Ti

11GB

NVIDIA GeForce RTX 3050

6GB

AMD Ryzen 9 6900HX with Radeon Graphics (znver3)

14.9GB

DeepSeek R1 Distill Llama 8B - Q4_K - Medium

LEADERBOARD
NVIDIA GeForce RTX 2080 Ti
GPU / 11GB
PROMPT
2034
tokens/s
GENERATION
68.3
tokens/s
TTFT
611
ms
LOCALSCORE
610
NVIDIA GeForce RTX 3050
GPU / 6GB
PROMPT
813
tokens/s
GENERATION
26.0
tokens/s
TTFT
1.65
sec
LOCALSCORE
234