logo
HomeLatest ResultsDownloadAboutBlog
model icon

Phi 3 Mini 128k Instruct

Q6_K

3.8Bparams
COMPARE ACCELERATORS

1 accelerators tested

Select Accelerators

NVIDIA GeForce RTX 3090

24GB

Phi 3 Mini 128k Instruct - Q6_K

LEADERBOARD
NVIDIA GeForce RTX 3090
GPU / 24GB
PROMPT
4481
tokens/s
GENERATION
132
tokens/s
TTFT
287
ms
LOCALSCORE
1272