Params
2B
Fastest decode
351 tok/s
RTX 5090 32GB · Q4_K_M GGUF
Refusal
Official
Setups
1
Best reported pair · not live serving speed ↗
Runs on
Quoted one-stream decode on real boxes.
No public weights link on this desk yet.
Qwen · dense
Params
2B
Fastest decode
351 tok/s
RTX 5090 32GB · Q4_K_M GGUF
Refusal
Official
Setups
1
Best reported pair · not live serving speed ↗
Quoted one-stream decode on real boxes.
No public weights link on this desk yet.