logo
HomeLatest ResultsDownloadAboutBlog
model icon

Qwen3 8B

Q4_K - Medium

8.2Bparams
COMPARE ACCELERATORS

2 accelerators tested

Select Accelerators

NVIDIA GeForce RTX 3090

24GB

Apple M2 Pro 6P+4E+16GPU

16GB

Qwen3 8B - Q4_K - Medium

LEADERBOARD
NVIDIA GeForce RTX 3090
GPU / 24GB
PROMPT
2970
tokens/s
GENERATION
59.7
tokens/s
TTFT
432
ms
LOCALSCORE
743
Apple M2 Pro 6P+4E+16GPU
GPU / 16GB
PROMPT
223
tokens/s
GENERATION
23.0
tokens/s
TTFT
5.59
sec
LOCALSCORE
97