Titulm Mpt 1b v2.0
Q4_K - Medium
1.5Bparams
COMPARE ACCELERATORS
1 accelerators tested
Select Accelerators
NVIDIA GeForce RTX 4050 Laptop GPU
6GB
Titulm Mpt 1b v2.0 - Q4_K - Medium
LEADERBOARD
GPU / 6GB
PROMPT
4778
tokens/s
GENERATION
102
tokens/s
TTFT
298
ms
LOCALSCORE
1179