logo
HomeLatest ResultsDownloadAboutBlog
model icon

Granite 3.3 8b Instruct

Q4_K - Medium

8.4Bparams
COMPARE ACCELERATORS

1 accelerators tested

Select Accelerators

NVIDIA GeForce RTX 3050

6GB

Granite 3.3 8b Instruct - Q4_K - Medium

LEADERBOARD
NVIDIA GeForce RTX 3050
GPU / 6GB
PROMPT
594
tokens/s
GENERATION
23.5
tokens/s
TTFT
4.54
sec
LOCALSCORE
146