logo
HomeLatest ResultsDownloadAboutBlog
model icon

Phi3

F16

3.8Bparams
COMPARE ACCELERATORS

3 accelerators tested

Select Accelerators

NVIDIA GeForce RTX 4090

24GB

AMD Radeon Graphics

15GB

AMD Ryzen 5 7640U w/ Radeon 760M Graphics (znver4)

30.7GB

Phi3 - F16

LEADERBOARD
NVIDIA GeForce RTX 4090
GPU / 24GB
PROMPT
6298
tokens/s
GENERATION
41.3
tokens/s
TTFT
208
ms
LOCALSCORE
1077
AMD Radeon Graphics
GPU / 15GB
PROMPT
121
tokens/s
GENERATION
2.0
tokens/s
TTFT
11.20
sec
LOCALSCORE
28