Astral 0.6B Coder
Q5_K - Medium
752Mparams
COMPARE ACCELERATORS
2 accelerators tested
Select Accelerators
NVIDIA GeForce RTX 4050 Laptop GPU
6GB
12th Gen Intel Core i3-1215U (alderlake)
11.7GB
Astral 0.6B Coder - Q5_K - Medium
LEADERBOARD
GPU / 6GB
PROMPT
6593
tokens/s
GENERATION
113
tokens/s
TTFT
235
ms
LOCALSCORE
1469