..
Q4_0
1.1Bparams
COMPARE ACCELERATORS
9 accelerators tested
Select Accelerators
NVIDIA RTX 2000 Ada Generation
16GB
AMD Ryzen 9 9950X3D 16-Core Processor
60.4GB
AMD Ryzen 7 8700G w/ Radeon 780M Graphics (znver4)
29GB
AMD Ryzen 7 5700G with Radeon Graphics (znver3)
58.7GB
AMD Ryzen 7 260 w/ Radeon 780M Graphics (znver4)
31.3GB
.. - Q4_0
LEADERBOARD
GPU / 16GB
PROMPT
5429
tokens/s
GENERATION
175
tokens/s
TTFT
299
ms
LOCALSCORE
1470