Hacker News
new
|
past
|
comments
|
ask
|
show
|
jobs
|
submit
login
tomr75
on Aug 25, 2023
|
parent
|
context
|
favorite
| on:
Beating GPT-4 on HumanEval with a fine-tuned CodeL...
what hardware could one run this locally on? probably need 3090 etc right?
finally a reason to upgrade from my m1 max
redox99
on Aug 25, 2023
|
next
[–]
34B is basically an exact fit for a 3090, when quantized to 4 bits.
disconcision
on Aug 25, 2023
|
prev
[–]
maybe worth noting that depending on specifics a 3090 isn't necessarily a strict upgrade over an M1 max. While a 3090 will be faster on any model it can run, an M1 with 32GB of ram or more can load models which a 3090 cannot
Guidelines
|
FAQ
|
Lists
|
API
|
Security
|
Legal
|
Apply to YC
|
Contact
Search:
finally a reason to upgrade from my m1 max