logo
HomeLatest ResultsDownloadAboutBlog
model icon

Phi 3 Mini 128k Instruct

Q4_K - Medium

3.8Bparams
COMPARE ACCELERATORS

1 accelerators tested

Select Accelerators

Apple M1 Max 8P+2E+24GPU

64GB

Phi 3 Mini 128k Instruct - Q4_K - Medium

LEADERBOARD
Apple M1 Max 8P+2E+24GPU
GPU / 64GB
PROMPT
450
tokens/s
GENERATION
37.1
tokens/s
TTFT
2.56
sec
LOCALSCORE
187