logo
HomeLatest ResultsDownloadAboutBlog
Latest LocalScore Results
Test #878

05/15/2025 - 5:15 AM

Accelerator icon
NVIDIA GeForce RTX 3090
GPU
24
GB
model icon

Llama 3.2 1B Instruct

Q4_K - Medium

1.5Bparams

321

tokens/s

generation

99

ms

time to first token

13357

tokens/s

prompt

3510

LocalScore

CPU
AMD EPYC 7352 24-Core Processor (znver2)
RAM
125.6GB
OS
Linux
Test #877

05/15/2025 - 1:59 AM

Accelerator icon
Apple M4 Pro 10P+4E+20GPU
GPU
48
GB
model icon

Qwen2.5 14B Instruct

Q4_K - Medium

14.8Bparams

18.1

tokens/s

generation

6.66

sec

time to first token

189

tokens/s

prompt

80

LocalScore

CPU
Apple M4 Pro 10P+4E
RAM
48GB
OS
Darwin
Test #876

05/14/2025 - 11:24 PM

Accelerator icon
Apple M1 4P+4E+8GPU
GPU
8
GB
model icon

Qwen3 0.6B

Q4_K - Medium

752Mparams

47.5

tokens/s

generation

1.47

sec

time to first token

912

tokens/s

prompt

309

LocalScore

CPU
Apple M1 4P+4E
RAM
8GB
OS
Darwin
Test #875

05/14/2025 - 10:58 PM

Accelerator icon
NVIDIA GeForce RTX 3060 Laptop GPU
GPU
6
GB
model icon

active

Q2_K - Medium

1.1Bparams

101

tokens/s

generation

347

ms

time to first token

3970

tokens/s

prompt

1049

LocalScore

CPU
11th Gen Intel Core i7-11800H @ 2.30GHz (tigerlake)
RAM
15.8GB
OS
Windows
Test #874

05/14/2025 - 10:57 PM

Accelerator icon
NVIDIA GeForce RTX 3060 Laptop GPU
GPU
6
GB
model icon

Llama 3.2 1B Instruct

Q4_K - Medium

1.5Bparams

126

tokens/s

generation

268

ms

time to first token

5096

tokens/s

prompt

1339

LocalScore

CPU
11th Gen Intel Core i7-11800H @ 2.30GHz (tigerlake)
RAM
15.8GB
OS
Windows
Test #873

05/14/2025 - 10:55 PM

Accelerator icon
NVIDIA GeForce RTX 3060 Laptop GPU
GPU
6
GB
model icon

Gemma 3 1b It

Q4_K - Medium

1.3Bparams

73.8

tokens/s

generation

190

ms

time to first token

6477

tokens/s

prompt

1359

LocalScore

CPU
11th Gen Intel Core i7-11800H @ 2.30GHz (tigerlake)
RAM
15.8GB
OS
Windows
Test #872

05/14/2025 - 10:49 PM

Accelerator icon
NVIDIA GeForce RTX 3060 Laptop GPU
GPU
6
GB
model icon

Gemma 3 1b It

BF16

1.3Bparams

21.0

tokens/s

generation

460

ms

time to first token

2679

tokens/s

prompt

497

LocalScore

CPU
11th Gen Intel Core i7-11800H @ 2.30GHz (tigerlake)
RAM
15.8GB
OS
Windows
Test #871

05/14/2025 - 10:18 PM

Accelerator icon
NVIDIA GeForce RTX 3060 Laptop GPU
GPU
6
GB
model icon

Gemma 3 1b It

BF16

1.3Bparams

22.1

tokens/s

generation

404

ms

time to first token

3121

tokens/s

prompt

555

LocalScore

CPU
11th Gen Intel Core i7-11800H @ 2.30GHz (tigerlake)
RAM
15.8GB
OS
Windows
Test #870

05/14/2025 - 10:07 PM

Accelerator icon
Apple M1 Pro 8P+2E+16GPU
GPU
32
GB
model icon

Qwen3 0.6B Instruct

Q8_0

752Mparams

82.5

tokens/s

generation

667

ms

time to first token

1817

tokens/s

prompt

608

LocalScore

CPU
Apple M1 Pro 8P+2E
RAM
32GB
OS
Darwin
Test #869

05/14/2025 - 4:51 PM

Accelerator icon
NVIDIA GeForce RTX 3090
GPU
24
GB
model icon

Qwen3 30B A3B

Q4_K - Medium

30.5Bparams

43.2

tokens/s

generation

1.40

sec

time to first token

814

tokens/s

prompt

293

LocalScore

CPU
AMD EPYC 7352 24-Core Processor (znver2)
RAM
125.6GB
OS
Linux