logo
HomeLatest ResultsDownloadAboutBlog
model icon

meta-llama-7b

Q5_K - Medium

6.7Bparams
COMPARE ACCELERATORS

1 accelerators tested

Select Accelerators

Apple M4 Pro 8P+4E+16GPU

24GB

meta-llama-7b - Q5_K - Medium

LEADERBOARD
Apple M4 Pro 8P+4E+16GPU
GPU / 24GB
PROMPT
291
tokens/s
GENERATION
24.4
tokens/s
TTFT
4.30
sec
LOCALSCORE
118