logo
HomeLatest ResultsDownloadAboutBlog
model icon

CodeLlama 7b Instruct Hf

Q4_K - Medium

6.7Bparams
COMPARE ACCELERATORS

1 accelerators tested

Select Accelerators

AMD Radeon RX 7800 XT

16GB

CodeLlama 7b Instruct Hf - Q4_K - Medium

LEADERBOARD
AMD Radeon RX 7800 XT
GPU / 16GB
PROMPT
594
tokens/s
GENERATION
46.8
tokens/s
TTFT
2.39
sec
LOCALSCORE
227