logo
HomeLatest ResultsDownloadAboutBlog
model icon

DeepSeek R1 Distill Qwen 7B

Q4_K - Medium

7.6Bparams
COMPARE ACCELERATORS

3 accelerators tested

Select Accelerators

NVIDIA GeForce RTX 3050

6GB

Apple M4 Max 10P+4E+32GPU

36GB

NVIDIA GeForce GTX 1060 6GB

6GB

DeepSeek R1 Distill Qwen 7B - Q4_K - Medium

LEADERBOARD
NVIDIA GeForce RTX 3050
GPU / 6GB
PROMPT
911
tokens/s
GENERATION
27.3
tokens/s
TTFT
1.42
sec
LOCALSCORE
260
Apple M4 Max 10P+4E+32GPU
GPU / 36GB
PROMPT
598
tokens/s
GENERATION
51.9
tokens/s
TTFT
2.02
sec
LOCALSCORE
249
NVIDIA GeForce GTX 1060 6GB
GPU / 6GB
PROMPT
365
tokens/s
GENERATION
19.1
tokens/s
TTFT
3.53
sec
LOCALSCORE
125