TinyLLama
F16
5Mparams
COMPARE ACCELERATORS
3 accelerators tested
Select Accelerators
NVIDIA GeForce RTX 4050 Laptop GPU
6GB
12th Gen Intel Core i3-1215U (alderlake)
11.7GB
AMD A6-5200 APU with Radeon HD Graphics
3.3GB
TinyLLama - F16
LEADERBOARD
GPU / 6GB
PROMPT
38404
tokens/s
GENERATION
657
tokens/s
TTFT
47
ms
LOCALSCORE
8128