model icon

Llama 3.1 8B Instruct Abliterated_Via_Adapter

Q4_K - Medium

8.0Bparams
COMPARE ACCELERATORS

1 accelerators tested

Select Accelerators

AMD Radeon RX 6600 XT

8GB

Llama 3.1 8B Instruct Abliterated_Via_Adapter - Q4_K - Medium

LEADERBOARD
PROMPT
462
tokens/s
GENERATION
21.9
tokens/s
TTFT
3.51
sec
LOCALSCORE
142