logo
HomeLatest ResultsDownloadAboutBlog
model icon

QwQ 32B

Q4_K - Medium

32.8Bparams
COMPARE ACCELERATORS

1 accelerators tested

Select Accelerators

NVIDIA GeForce RTX 3090

24GB

QwQ 32B - Q4_K - Medium

LEADERBOARD
NVIDIA GeForce RTX 3090
GPU / 24GB
PROMPT
915
tokens/s
GENERATION
30.5
tokens/s
TTFT
1.38
sec
LOCALSCORE
273