logo
HomeLatest ResultsDownloadAboutBlog
model icon

Local_Pretrained_Model

Q4_K - Medium

14.8Bparams
COMPARE ACCELERATORS

1 accelerators tested

Select Accelerators

NVIDIA GeForce RTX 4070 Ti

12GB

Local_Pretrained_Model - Q4_K - Medium

LEADERBOARD
NVIDIA GeForce RTX 4070 Ti
GPU / 12GB
PROMPT
1995
tokens/s
GENERATION
39.6
tokens/s
TTFT
666
ms
LOCALSCORE
491