Nemotron Cascade 8B
Q4_K - Medium
8.2Bparams
COMPARE ACCELERATORS
1 accelerators tested
Select Accelerators
NVIDIA GeForce RTX 4050 Laptop GPU
6GB
Nemotron Cascade 8B - Q4_K - Medium
LEADERBOARD
GPU / 6GB
PROMPT
1132
tokens/s
GENERATION
30.1
tokens/s
TTFT
1.93
sec
LOCALSCORE
260