logo
HomeLatest ResultsDownloadAboutBlog
model icon

Phi 4 Mini Instruct

Q4_K - Medium

4.5Bparams
COMPARE ACCELERATORS

3 accelerators tested

Select Accelerators

NVIDIA GeForce RTX 3090

24GB

NVIDIA GeForce RTX 4050 Laptop GPU

6GB

NVIDIA GeForce GTX 1660

6GB

Phi 4 Mini Instruct - Q4_K - Medium

LEADERBOARD
NVIDIA GeForce RTX 3090
GPU / 24GB
PROMPT
5535
tokens/s
GENERATION
145
tokens/s
TTFT
231
ms
LOCALSCORE
1515
NVIDIA GeForce RTX 4050 Laptop GPU
GPU / 6GB
PROMPT
2065
tokens/s
GENERATION
50.5
tokens/s
TTFT
664
ms
LOCALSCORE
539
NVIDIA GeForce GTX 1660
GPU / 6GB
PROMPT
244
tokens/s
GENERATION
17.0
tokens/s
TTFT
5.97
sec
LOCALSCORE
89