to stay fairer, the required extra disk space for snowflake-arctic is cheaper th... | Hacker News

Hacker Newsnew | past | comments | ask | show | jobs | submit

		fsiefken on April 24, 2024 \| parent \| context \| favorite \| on: Snowflake Arctic Instruct (128x3B MoE), largest op... to stay fairer, the required extra disk space for snowflake-arctic is cheaper then the required extra ram memory for llama3

Manabu-eo on April 25, 2024 [–]

For decent performance, you need to keep all the parameters on memory for both. Well, with a raid-0 of two PCIe 5 SSDs (or 4 PCIe 4) you might get 1 t/s loading experts from disk on snowflake-artic... but that is slooow.

Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact