model icon

Models Mlx Community Meta Llama 3.1 8B Instruct Bf16

Q6_K

8.0Bparams
COMPARE ACCELERATORS

1 accelerators tested

Select Accelerators

Apple M3 4P+4E+10GPU

24GB

Models Mlx Community Meta Llama 3.1 8B Instruct Bf16 - Q6_K

LEADERBOARD
PROMPT
113
tokens/s
GENERATION
7.9
tokens/s
TTFT
10.84
sec
LOCALSCORE
44