Accelerator icon
Raspberry Pi 5 Model B Rev 1.0
CPU
7.8
GB
PERFORMANCE OVERVIEW
Model
..
Q4_01.1B
Llama 3.2 1B Instruct
Q4_K - Medium1.5B
Prompt Speed
36tokens/s
47tokens/s
Generation Speed
8.1tokens/s
9.8tokens/s
Time to First Token
55.23sec
31.70sec
LocalScore
17
24
COMPARE MODELS

2 models tested

Select Models

Llama 3.2 1B Instruct

Q4_K - Medium

..

Q4_0

Raspberry Pi 5 Model B Rev 1.0 - 7.8GB