logo
HomeLatest ResultsDownloadAboutBlog
model icon

codegeex4-all-9b

Q4_K - Medium

9.4Bparams
COMPARE ACCELERATORS

1 accelerators tested

Select Accelerators

NVIDIA GeForce RTX 2080 Ti

11GB

codegeex4-all-9b - Q4_K - Medium

LEADERBOARD
NVIDIA GeForce RTX 2080 Ti
GPU / 11GB
PROMPT
1676
tokens/s
GENERATION
53.2
tokens/s
TTFT
761
ms
LOCALSCORE
489