Thanks to unsloth, we immediately get 4-bit quantization: https://huggingface.co... | Hacker News

Hacker Newsnew | past | comments | ask | show | jobs | submit

throwaw12 83 days ago | parent | context | favorite | on: Qwen/Qwen3.6-27B · Hugging Face

Thanks to unsloth, we immediately get 4-bit quantization: https://huggingface.co/unsloth/Qwen3.6-27B-GGUF

perarneng 83 days ago [–]

Im waiting for nvfp4 quant :-)

EnPissant 82 days ago | [–]

Are nvfp4 / mxfp4 even useful without QAT?

Consider applying for YC's Fall 2026 batch! Applications are open till July 27.
Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact