logo
HomeLatest ResultsDownloadAboutBlog
model icon

Granite 3.1 8b Instruct

Q4_K - Medium

8.4Bparams
COMPARE ACCELERATORS

1 accelerators tested

Select Accelerators

AMD Radeon RX 7800 XT

16GB

Granite 3.1 8b Instruct - Q4_K - Medium

LEADERBOARD
AMD Radeon RX 7800 XT
GPU / 16GB
PROMPT
487
tokens/s
GENERATION
30.6
tokens/s
TTFT
2.72
sec
LOCALSCORE
176