logo
HomeLatest ResultsDownloadAboutBlog
model icon

Cogito v1 Preview Llama 8B

Q8_0

8.0Bparams
COMPARE ACCELERATORS

1 accelerators tested

Select Accelerators

NVIDIA GeForce RTX 4070 Ti

12GB

Cogito v1 Preview Llama 8B - Q8_0

LEADERBOARD
NVIDIA GeForce RTX 4070 Ti
GPU / 12GB
PROMPT
3730
tokens/s
GENERATION
45.2
tokens/s
TTFT
368
ms
LOCALSCORE
771