Accelerator icon
Apple M5 4P+6E+8GPU
GPU
16
GB
PERFORMANCE OVERVIEW
Model
Llama 3.2 1B Instruct
Q4_K - Medium1.5B
Meta Llama 3.1 8B Instruct
Q4_K - Medium8.0B
Prompt Speed
1050tokens/s
164tokens/s
Generation Speed
96.8tokens/s
22.0tokens/s
Time to First Token
1.19sec
7.58sec
LocalScore
440
78
COMPARE MODELS

2 models tested

Select Models

Llama 3.2 1B Instruct

Q4_K - Medium

Meta Llama 3.1 8B Instruct

Q4_K - Medium

Apple M5 4P+6E+8GPU - 16GB