model icon

DeepSeek R1 Distill Llama 8B

Q6_K

8.0Bparams
COMPARE ACCELERATORS

1 accelerators tested

Select Accelerators

NVIDIA GeForce RTX 3070

8GB

DeepSeek R1 Distill Llama 8B - Q6_K

LEADERBOARD
PROMPT
2033
tokens/s
GENERATION
52.8
tokens/s
TTFT
641
ms
LOCALSCORE
551