model icon

..

Q4_0

1.1Bparams
COMPARE ACCELERATORS

4 accelerators tested

Select Accelerators

NVIDIA RTX 2000 Ada Generation

16GB

AMD Ryzen 7 5700G with Radeon Graphics (znver3)

58.7GB

11th Gen Intel Core i5-1155G7 @ 2.50GHz (tigerlake)

62.5GB

Raspberry Pi 5 Model B Rev 1.0

7.8GB

.. - Q4_0

LEADERBOARD
PROMPT
5343
tokens/s
GENERATION
174
tokens/s
TTFT
303
ms
LOCALSCORE
1452