logo
HomeLatest ResultsDownloadAboutBlog
model icon

DeepSeek R1 Distill Qwen 1.5B

Q4_K - Medium

1.8Bparams
COMPARE ACCELERATORS

4 accelerators tested

Select Accelerators

Apple M4 Max 10P+4E+32GPU

36GB

NVIDIA GeForce RTX 3050

6GB

NVIDIA GeForce GTX 1060 6GB

6GB

15.6GB

DeepSeek R1 Distill Qwen 1.5B - Q4_K - Medium

LEADERBOARD
Apple M4 Max 10P+4E+32GPU
GPU / 36GB
PROMPT
2424
tokens/s
GENERATION
133
tokens/s
TTFT
483
ms
LOCALSCORE
874
NVIDIA GeForce RTX 3050
GPU / 6GB
PROMPT
2851
tokens/s
GENERATION
60.4
tokens/s
TTFT
447
ms
LOCALSCORE
728
NVIDIA GeForce GTX 1060 6GB
GPU / 6GB
PROMPT
1475
tokens/s
GENERATION
62.5
tokens/s
TTFT
897
ms
LOCALSCORE
468