Lastest LocalScore Results

Home Latest Results Download About Blog

Latest LocalScore Results

06/15/2025 - 12:19 PM

Apple M2 Pro 8P+4E+19GPU

GPU

32

GB

Meta Llama 3.1 8B Instruct

Q4_K - Medium

8.0Bparams

26.3

tokens/s

generation

4.70

sec

time to first token

262

tokens/s

prompt

114

LocalScore

CPU

Apple M2 Pro 8P+4E

RAM

32GB

OS

Darwin

06/15/2025 - 2:18 AM

NVIDIA GeForce GTX 1080 Ti

GPU

11

GB

DeepSeek R1 Distill Qwen 14B

Q4_K - Medium

14.8Bparams

20.1

tokens/s

generation

2.84

sec

time to first token

442

tokens/s

prompt

146

LocalScore

CPU

AMD FX(tm)-8320 Eight-Core Processor (bdver2)

RAM

7.5GB

OS

Linux

06/15/2025 - 1:13 AM

NVIDIA GeForce GTX 1080 Ti

GPU

11

GB

Qwen2.5 14B Instruct

Q4_K - Medium

14.8Bparams

21.1

tokens/s

generation

2.82

sec

time to first token

449

tokens/s

prompt

150

LocalScore

CPU

AMD FX(tm)-8320 Eight-Core Processor (bdver2)

RAM

7.5GB

OS

Linux

06/15/2025 - 12:57 AM

NVIDIA GeForce GTX 1080 Ti

GPU

11

GB

Qwen2.5 14B Instruct

Q4_K - Medium

14.8Bparams

20.2

tokens/s

generation

2.96

sec

time to first token

424

tokens/s

prompt

142

LocalScore

CPU

AMD FX(tm)-8320 Eight-Core Processor (bdver2)

RAM

7.5GB

OS

Linux

06/14/2025 - 11:22 PM

Apple M1 4P+4E+8GPU

GPU

16

GB

Qwen2.5 14B Instruct

Q4_K - Medium

14.8Bparams

5.4

tokens/s

generation

24.55

sec

time to first token

53

tokens/s

prompt

23

LocalScore

CPU

Apple M1 4P+4E

RAM

16GB

OS

Darwin

06/14/2025 - 10:56 PM

NVIDIA GeForce GTX 1080 Ti

GPU

11

GB

Gemma 3 1b It

Q4_K - Medium

1.3Bparams

128

tokens/s

generation

233

ms

time to first token

5367

tokens/s

prompt

1432

LocalScore

CPU

AMD FX(tm)-8320 Eight-Core Processor (bdver2)

RAM

7.5GB

OS

Linux

06/14/2025 - 10:54 PM

NVIDIA GeForce RTX 4060 Ti

GPU

16

GB

Llama 3.2 1B Instruct

Q4_K - Medium

1.5Bparams

219

tokens/s

generation

166

ms

time to first token

9424

tokens/s

prompt

2317

LocalScore

CPU

AMD Ryzen 9 5950X 16-Core Processor (znver3)

RAM

62.7GB

OS

Linux

06/14/2025 - 10:53 PM

NVIDIA GeForce GTX 1080 Ti

GPU

11

GB

Gemma 3 4b It

Q4_K - Medium

4.6Bparams

57.3

tokens/s

generation

773

ms

time to first token

1628

tokens/s

prompt

494

LocalScore

CPU

AMD FX(tm)-8320 Eight-Core Processor (bdver2)

RAM

7.5GB

OS

Linux

06/14/2025 - 3:12 PM

Apple M2 Pro 8P+4E+19GPU

GPU

32

GB

Llama 3.2 1B Instruct

Q4_K - Medium

1.5Bparams

99.3

tokens/s

generation

803

ms

time to first token

1495

tokens/s

prompt

570

LocalScore

CPU

Apple M2 Pro 8P+4E

RAM

32GB

OS

Darwin

06/14/2025 - 2:57 PM

Apple M2 Pro 8P+4E+19GPU

GPU

32

GB

Meta Llama 3.1 8B Instruct

Q4_K - Medium

8.0Bparams

26.3

tokens/s

generation

4.71

sec

time to first token

262

tokens/s

prompt

113

LocalScore

CPU

Apple M2 Pro 8P+4E

RAM

32GB

OS

Darwin