logo
HomeLatest ResultsDownloadAboutBlog

LocalScore is an open benchmark which helps you understand how well your computer can handle local AI tasks.

LEADERBOARD
model icon
NVIDIA RTX PRO 6000 Blackwell Workstation Edition
GPU / 95GB
PROMPT
8479
tokens/s
GENERATION
138
tokens/s
TTFT
146
ms
LOCALSCORE
2000
NVIDIA RTX 6000 Ada Generation
GPU / 47GB
PROMPT
6808
tokens/s
GENERATION
121
tokens/s
TTFT
199
ms
LOCALSCORE
1605
NVIDIA H100 PCIe
GPU / 79GB
PROMPT
5202
tokens/s
GENERATION
120
tokens/s
TTFT
236
ms
LOCALSCORE
1382
NVIDIA GeForce RTX 4090
GPU / 24GB
PROMPT
6202
tokens/s
GENERATION
78.7
tokens/s
TTFT
224
ms
LOCALSCORE
1306
NVIDIA GeForce RTX 5090
GPU / 31GB
PROMPT
6477
tokens/s
GENERATION
65.1
tokens/s
TTFT
217
ms
LOCALSCORE
1260
NVIDIA GeForce RTX 4080
GPU / 16GB
PROMPT
4792
tokens/s
GENERATION
88.3
tokens/s
TTFT
279
ms
LOCALSCORE
1149
NVIDIA GeForce RTX 3090 Ti
GPU / 24GB
PROMPT
4024
tokens/s
GENERATION
110
tokens/s
TTFT
320
ms
LOCALSCORE
1113
NVIDIA A100-SXM4-80GB
GPU / 79GB
PROMPT
3571
tokens/s
GENERATION
110
tokens/s
TTFT
336
ms
LOCALSCORE
1054
NVIDIA GeForce RTX 3080 Ti
GPU / 12GB
PROMPT
3739
tokens/s
GENERATION
104
tokens/s
TTFT
343
ms
LOCALSCORE
1042
NVIDIA RTX 6000 Ada Generation
GPU / 48GB
PROMPT
5487
tokens/s
GENERATION
51.3
tokens/s
TTFT
252
ms
LOCALSCORE
1038
NVIDIA GeForce RTX 3090
GPU / 24GB
PROMPT
3692
tokens/s
GENERATION
98.0
tokens/s
TTFT
347
ms
LOCALSCORE
1013
NVIDIA GeForce RTX 4070 Ti SUPER
GPU / 16GB
PROMPT
4124
tokens/s
GENERATION
70.7
tokens/s
TTFT
320
ms
LOCALSCORE
967
NVIDIA RTX A6000
GPU / 48GB
PROMPT
3447
tokens/s
GENERATION
90.5
tokens/s
TTFT
378
ms
LOCALSCORE
938
NVIDIA GeForce RTX 3070 Ti
GPU / 8GB
PROMPT
2509
tokens/s
GENERATION
83.2
tokens/s
TTFT
520
ms
LOCALSCORE
738