Granite 3.1 1b A400M Instruct
Q5_K - Medium
1.4Bparams
COMPARE ACCELERATORS
3 accelerators tested
Select Accelerators
NVIDIA GeForce RTX 4050 Laptop GPU
6GB
12th Gen Intel Core i3-1215U (alderlake)
11.7GB
AMD A6-5200 APU with Radeon HD Graphics
3.3GB
Granite 3.1 1b A400M Instruct - Q5_K - Medium
LEADERBOARD
GPU / 6GB
PROMPT
3457
tokens/s
GENERATION
62.1
tokens/s
TTFT
348
ms
LOCALSCORE
851