Lastest LocalScore Results

Home Latest Results Download About Blog

Latest LocalScore Results

11/29/2025 - 7:53 AM

Apple M4 Pro 8P+4E+16GPU

GPU

24

GB

Meta Llama 3.1 8B Instruct

Q4_K - Medium

8.0Bparams

30.5

tokens/s

generation

4.15

sec

time to first token

302

tokens/s

prompt

130

LocalScore

CPU

Apple M4 Pro 8P+4E

RAM

24GB

OS

Darwin

11/28/2025 - 2:15 PM

Intel Core Ultra 9 185H (alderlake)

CPU

31.4

GB

Qwen2.5 14B Instruct

Q4_K - Medium

14.8Bparams

3.5

tokens/s

generation

107.80

sec

time to first token

12

tokens/s

prompt

7

LocalScore

CPU

Intel Core Ultra 9 185H (alderlake)

RAM

31.4GB

OS

Windows

11/28/2025 - 1:13 PM

NVIDIA GeForce RTX 4070 SUPER

GPU

12

GB

Llama 3.2 1B Instruct

Q4_K - Medium

1.5Bparams

218

tokens/s

generation

109

ms

time to first token

13459

tokens/s

prompt

3000

LocalScore

CPU

12th Gen Intel Core i9-12900KS (alderlake)

RAM

31.7GB

OS

Windows

11/28/2025 - 1:15 AM

GPU

24

GB

Qwen2.5 14B Instruct

Q4_K - Medium

14.8Bparams

15.7

tokens/s

generation

3.50

sec

time to first token

339

tokens/s

prompt

115

LocalScore

CPU

Intel Xeon CPU E5-2670 0 @ 2.60GHz (sandybridge)

RAM

377.8GB

OS

Linux

11/28/2025 - 12:59 AM

GPU

24

GB

Qwen3-Coder-30B-A3B-Instruct-1M

Q4_K - Medium

30.5Bparams

29.3

tokens/s

generation

4.04

sec

time to first token

288

tokens/s

prompt

128

LocalScore

CPU

Intel Xeon CPU E5-2670 0 @ 2.60GHz (sandybridge)

RAM

377.8GB

OS

Linux

11/27/2025 - 5:22 PM

Intel Core i5-8500 CPU @ 3.00GHz (skylake)

CPU

31.8

GB

Llama 3.2 1B Instruct

Q4_K - Medium

1.5Bparams

26.8

tokens/s

generation

12.83

sec

time to first token

116

tokens/s

prompt

62

LocalScore

CPU

Intel Core i5-8500 CPU @ 3.00GHz (skylake)

RAM

31.8GB

OS

Windows

11/26/2025 - 7:41 PM

NVIDIA GeForce RTX 4090

GPU

24

GB

Llama 3.2 1B Instruct

Q4_K - Medium

1.5Bparams

432

tokens/s

generation

52

ms

time to first token

27767

tokens/s

prompt

6127

LocalScore

CPU

AMD Ryzen 9 5950X 16-Core Processor (znver3)

RAM

125.7GB

OS

Linux

11/26/2025 - 7:40 PM

NVIDIA GeForce RTX 4090

GPU

24

GB

Meta Llama 3.1 8B Instruct

Q4_K - Medium

8.0Bparams

125

tokens/s

generation

170

ms

time to first token

7871

tokens/s

prompt

1797

LocalScore

CPU

AMD Ryzen 9 5950X 16-Core Processor (znver3)

RAM

125.7GB

OS

Linux

11/26/2025 - 7:35 PM

NVIDIA GeForce RTX 4090

GPU

24

GB

Qwen2.5 14B Instruct

Q4_K - Medium

14.8Bparams

72.5

tokens/s

generation

304

ms

time to first token

4361

tokens/s

prompt

1013

LocalScore

CPU

AMD Ryzen 9 5950X 16-Core Processor (znver3)

RAM

125.7GB

OS

Linux

11/26/2025 - 2:54 PM

GPU

120

GB

Qwen2.5 14B Instruct

Q4_K - Medium

14.8Bparams

17.9

tokens/s

generation

1.24

sec

time to first token

1102

tokens/s

prompt

251

LocalScore

CPU

RAM

119.6GB

OS

Linux