10B \* 2000 t/s = 20,000 GB/s memory bandwidth . Apple hardware can do 1k GB/s . | Hacker News

Hacker Newsnew | past | comments | ask | show | jobs | submit

		coolspot 5 months ago \| parent \| context \| favorite \| on: Open models by OpenAI 10B * 2000 t/s = 20,000 GB/s memory bandwidth . Apple hardware can do 1k GB/s .

oezi 5 months ago [–]

That’s why MoE is needed.

Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact