logo
HomeLatest ResultsDownloadAboutBlog
model icon

Hf_Model

Q4_K - Medium

1.8Bparams
COMPARE ACCELERATORS

1 accelerators tested

Select Accelerators

NVIDIA GeForce GTX 1660

6GB

Hf_Model - Q4_K - Medium

LEADERBOARD
NVIDIA GeForce GTX 1660
GPU / 6GB
PROMPT
564
tokens/s
GENERATION
30.7
tokens/s
TTFT
2.46
sec
LOCALSCORE
192