How does embedding dimension size relate to maximum context length ? | Hacker News

Hacker Newsnew | past | comments | ask | show | jobs | submit

		HarHarVeryFunny on March 12, 2024 \| parent \| context \| favorite \| on: Stealing Part of a Production Language Model How does embedding dimension size relate to maximum context length ?

mfscholar on March 12, 2024 [–]

Embedding size and maximum context length are not related. The maximum context length of gpt-3.5-turbo is known though: 2^14

Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact