Accelerator icon
NVIDIA RTX 5000 Ada Generation Laptop GPU
GPU
16
GB
PERFORMANCE OVERVIEW
Model
Phi 4
Q2_K - Medium14.7B
Qwen2.5 14B Instruct
Q4_K - Medium14.8B
Prompt Speed
827tokens/s
952tokens/s
Generation Speed
21.3tokens/s
16.4tokens/s
Time to First Token
1.70sec
1.44sec
LocalScore
218
221
COMPARE MODELS

2 models tested

Select Models

Qwen2.5 14B Instruct

Q4_K - Medium

Phi 4

Q2_K - Medium

NVIDIA RTX 5000 Ada Generation Laptop GPU - 16GB