KomdigiUB 8B Instruct DTP
Q4_K - Medium
8.2Bparams
COMPARE ACCELERATORS
1 accelerators tested
Select Accelerators
NVIDIA GeForce RTX 4050 Laptop GPU
6GB
KomdigiUB 8B Instruct DTP - Q4_K - Medium
LEADERBOARD
GPU / 6GB
PROMPT
1151
tokens/s
GENERATION
29.9
tokens/s
TTFT
1.55
sec
LOCALSCORE
281