96 x A100 hours for a finetune according to the article. The cost of the dataset... | Hacker News

Hacker Newsnew | past | comments | ask | show | jobs | submit

		PeterStuer on Aug 26, 2023 \| parent \| context \| favorite \| on: Beating GPT-4 on HumanEval with a fine-tuned CodeL... 96 x A100 hours for a finetune according to the article. The cost of the dataset curation for a given language is hard to quantify as there are many unknowns. However, it seems perfectly crowdsourcable to volunteers.

albert_e on Aug 26, 2023 [–]

A project like SETI@home should help these efforts I believe?

Sabinus on Aug 27, 2023 | [–]

Maybe the stable horde could work it into the project.

https://stablehorde.net/

Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact