logo
HomeLatest ResultsDownloadAboutBlog
model icon

Granite 3.1 1b A400M Instruct

F16

1.4Bparams
COMPARE ACCELERATORS

1 accelerators tested

Select Accelerators

AMD Radeon RX 5700 XT

8GB

Granite 3.1 1b A400M Instruct - F16

LEADERBOARD
AMD Radeon RX 5700 XT
GPU / 8GB
PROMPT
1297
tokens/s
GENERATION
27.4
tokens/s
TTFT
911
ms
LOCALSCORE
339