Hacker Newsnew | past | comments | ask | show | jobs | submitlogin

they'll meet in the middle. that's what's already happening, and there will probably be co-processors added into consumer devices that excel specifically at the kind of processing that these models need.


> there will probably be co-processors added into consumer devices that excel specifically at the kind of processing that these models need.

There already are, e.g., Google Edge TPU, Apple Neural Engine, etc.


They don't help with the memory requirements of these LLMs though.


are any of the LLM or image AI like Stable Diffusion fine tuning methods leveraging Apple Neural Engine?

the best I've seen is a renderer leveraging "metal"




Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact

Search: