..
Q4_0
1.1Bparams
COMPARE ACCELERATORS
4 accelerators tested
Select Accelerators
NVIDIA RTX 2000 Ada Generation
16GB
AMD Ryzen 7 5700G with Radeon Graphics (znver3)
58.7GB
11th Gen Intel Core i5-1155G7 @ 2.50GHz (tigerlake)
62.5GB
Raspberry Pi 5 Model B Rev 1.0
7.8GB
.. - Q4_0
LEADERBOARD
GPU / 16GB
PROMPT
5343
tokens/s
GENERATION
174
tokens/s
TTFT
303
ms
LOCALSCORE
1452