tinyllama_tinyllama-1.1b-chat-v1.0
Q8_0
1.1Bparams
COMPARE ACCELERATORS
1 accelerators tested
Select Accelerators
NVIDIA GeForce RTX 4050 Laptop GPU
6GB
tinyllama_tinyllama-1.1b-chat-v1.0 - Q8_0
LEADERBOARD
GPU / 6GB
PROMPT
3987
tokens/s
GENERATION
99.5
tokens/s
TTFT
410
ms
LOCALSCORE
989