Hacker Newsnew | past | comments | ask | show | jobs | submitlogin

I made some dynamic GGUFs for the 32B MoE model! Try:

./llama.cpp/llama-cli -hf unsloth/granite-4.0-h-small-GGUF:UD-Q4_K_XL

Also a support agent finetuning notebook with granite 4: https://colab.research.google.com/github/unslothai/notebooks...



You guys are lightning fast. Did you folks have access to the model weights before hand or something, if you don't mind me asking?


Oh thanks! Yes sometimes we get early access to some models!


As always, you're awesome. keep up the great work!


Thanks!




Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact

Search: