logo
HomeLatest ResultsDownloadAboutBlog
model icon

Phi3

Q4_K - Medium

3.8Bparams
COMPARE ACCELERATORS

1 accelerators tested

Select Accelerators

NVIDIA GeForce GTX 1060 6GB

6GB

Phi3 - Q4_K - Medium

LEADERBOARD
NVIDIA GeForce GTX 1060 6GB
GPU / 6GB
PROMPT
516
tokens/s
GENERATION
27.3
tokens/s
TTFT
2.59
sec
LOCALSCORE
176