model icon

codellama_codellama-7b-instruct-hf

Q5_K - Medium

6.7Bparams
COMPARE ACCELERATORS

1 accelerators tested

Select Accelerators

NVIDIA GeForce RTX 4070 Ti

12GB

codellama_codellama-7b-instruct-hf - Q5_K - Medium

LEADERBOARD
PROMPT
3625
tokens/s
GENERATION
63.1
tokens/s
TTFT
385
ms
LOCALSCORE
841