Phi 4
Q2_K - Medium
14.7Bparams
COMPARE ACCELERATORS
1 accelerators tested
Select Accelerators
NVIDIA RTX 5000 Ada Generation Laptop GPU
16GB
Phi 4 - Q2_K - Medium
LEADERBOARD
PROMPT
827
tokens/s
GENERATION
21.3
tokens/s
TTFT
1.70
sec
LOCALSCORE
218
Phi 4
Q2_K - Medium
1 accelerators tested
Select Accelerators
NVIDIA RTX 5000 Ada Generation Laptop GPU
16GB