tinyllama_tinyllama-1.1b-chat-v1.0
Q4_K - Medium
1.1Bparams
COMPARE ACCELERATORS
3 accelerators tested
Select Accelerators
NVIDIA GeForce GTX 1060 3GB
3GB
NVIDIA GeForce GTX 1660 SUPER
6GB
Intel Core i5-10400 CPU @ 2.90GHz (skylake)
31.3GB
tinyllama_tinyllama-1.1b-chat-v1.0 - Q4_K - Medium
LEADERBOARD
GPU / 6GB
PROMPT
765
tokens/s
GENERATION
28.5
tokens/s
TTFT
1.99
sec
LOCALSCORE
222