Granite 3.0 1b A400M Instruct
Q6_K
6Mparams
COMPARE ACCELERATORS
5 accelerators tested
Select Accelerators
NVIDIA GeForce RTX 4050 Laptop GPU
6GB
12th Gen Intel Core i3-1215U (alderlake)
11.7GB
AMD A6-5200 APU with Radeon HD Graphics
3.3GB
Intel Celeron CPU N3350 @ 1.10GHz
3.8GB
Intel Atom CPU N2600 @ 1.60GHz
1.9GB
Granite 3.0 1b A400M Instruct - Q6_K
LEADERBOARD
GPU / 6GB
PROMPT
64106
tokens/s
GENERATION
400
tokens/s
TTFT
22
ms
LOCALSCORE
10533