Home
Latest Results
Download
About
Blog
Phi2
Q4_0
2.8B
params
COMPARE ACCELERATORS
1 accelerators tested
Select Accelerators
NVIDIA GeForce GTX 1060 6GB
6GB
Phi2 - Q4_0
Prompt tokens/s
Generation tokens/s
Time to First Token (ms)
LocalScore
LEADERBOARD
GPU
CPU+GPU
CPU
ACCELERATOR
PROMPT
GENERATION
TTFT
LOCALSCORE
NVIDIA GeForce GTX 1060 6GB
GPU / 6GB
PROMPT
760
tokens/s
GENERATION
37.6
tokens/s
TTFT
1.80
sec
LOCALSCORE
251
