logo
HomeLatest ResultsDownloadAboutBlog
model icon

Granite 3.3 8b Instruct

Q8_0

8.4Bparams
COMPARE ACCELERATORS

1 accelerators tested

Select Accelerators

NVIDIA GeForce RTX 4070 Ti

12GB

Granite 3.3 8b Instruct - Q8_0

LEADERBOARD
NVIDIA GeForce RTX 4070 Ti
GPU / 12GB
PROMPT
3211
tokens/s
GENERATION
40.4
tokens/s
TTFT
434
ms
LOCALSCORE
669