Llama 2 Tiny 4kv Heads 16layers Random
Q4_K - Medium
9Mparams
COMPARE ACCELERATORS
2 accelerators tested
Select Accelerators
NVIDIA GeForce RTX 4050 Laptop GPU
6GB
Intel Core i5-14450HX (alderlake)
15.7GB
Llama 2 Tiny 4kv Heads 16layers Random - Q4_K - Medium
LEADERBOARD
GPU / 6GB
PROMPT
10922
tokens/s
GENERATION
260
tokens/s
TTFT
173
ms
LOCALSCORE
2539