Granite 3.1 2b Instruct
Q6_K
3Mparams
COMPARE ACCELERATORS
8 accelerators tested
Select Accelerators
NVIDIA GeForce RTX 4050 Laptop GPU
6GB
Intel Core i5-14450HX (alderlake)
15.7GB
12th Gen Intel Core i3-1215U (alderlake)
11.7GB
AMD A6-5200 APU with Radeon HD Graphics
3.3GB
Intel Celeron CPU N3350 @ 1.10GHz
3.7GB
Granite 3.1 2b Instruct - Q6_K
LEADERBOARD
GPU / 6GB
PROMPT
96076
tokens/s
GENERATION
639
tokens/s
TTFT
15
ms
LOCALSCORE
16081