..
Q4_0
1.1Bparams
COMPARE ACCELERATORS
7 accelerators tested
Select Accelerators
NVIDIA RTX 2000 Ada Generation
16GB
AMD Ryzen 9 9950X3D 16-Core Processor
60.4GB
AMD Ryzen 7 8700G w/ Radeon 780M Graphics (znver4)
29GB
AMD Ryzen 7 5700G with Radeon Graphics (znver3)
58.7GB
AMD Ryzen 7 260 w/ Radeon 780M Graphics (znver4)
31.3GB
.. - Q4_0
LEADERBOARD
GPU / 16GB
PROMPT
5343
tokens/s
GENERATION
174
tokens/s
TTFT
303
ms
LOCALSCORE
1452