model icon

Meta Llama 3.1 8B Instruct Abliterated

Q4_K - Medium

8.0Bparams
COMPARE ACCELERATORS

1 accelerators tested

Select Accelerators

NVIDIA GeForce RTX 3090

24GB

Meta Llama 3.1 8B Instruct Abliterated - Q4_K - Medium

LEADERBOARD
PROMPT
2918
tokens/s
GENERATION
77.6
tokens/s
TTFT
437
ms
LOCALSCORE
804