INT8 LLMs for vLLM
Collection
Accurate INT8 quantized models by Neural Magic, ready for use with vLLM!
• 47 items • Updated • 19
Zheng Han
traphix
·
AI & ML interests
None yet
Recent Activity
new activity 5 days ago
nm-testing/MiniMax-M2.5-W4A16:oneshot vs model_free_ptq? which one has better recovery? new activity 11 days ago
RedHatAI/Qwen3.5-397B-A17B-FP8-dynamic:W4A16 quant new activity 12 days ago
apolo13x/Qwen3.5-35B-A3B-quantized.w4a16:Any creation details?Organizations
None yet
upvoted a collection over 1 year ago