Hacker Newsnew | past | comments | ask | show | jobs | submitlogin
Gemma 3 Inference: vLLM on GKE. Over 22k token/s (medium.com/google-cloud)
2 points by m4r1k 10 months ago | hide | past | favorite


Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact

Search: