Hacker Newsnew | past | comments | ask | show | jobs | submitlogin

Isn't that what they meant by this?

> the comparison is not apples-to-apples, because each synapse is much more complex than a single parameter in a weight matrix.



It isn't just "not apples to apples". It's apples to supercomputers.


well yeah but it's un-obviously a very big difference that basically invalidates any conclusion that you can make with this comparison.


I don't think so: it seems reasonable to assume that biological neurons are strictly more powerful than "neural network" weights, so the fact that a human brain has 3 orders of magnitude more biological neurons than language models have weights tells that we should expect, as an extreme lower bound, 3 orders of magnitude difference.




Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact

Search: