I take it that asking things about the repository with gpt3.5-turbo-16k is not possible without adding each file separately?
Just to test I generated ctags for my smallish Rust project and noticed it comes to around 10k tokens according to https://platform.openai.com/tokenizer.
I don't have GPT-4 API access yet but it appears it would get quite expensive with the 32k context.
Correct, right now aider does not provide the ctags repo map to any gpt-3.5 models. I still need to evaluate if those models can actually understand and use the map effectively.
Improving and deepening support for the 3.5 models is probably my top priority next effort. Previously, they were barely useful for editing code. The 16k context window and functions support may have shifted that balance, so I need to dig in more.
One other thing to note is that aider now distills the repo map to fit within a token budget. The default is 1k tokens, specified via `--map-tokens`. It tries to use the budget to convey the most important parts of the repo map to GPT. So in theory, even very large repos should get a useful map.
I take it that asking things about the repository with gpt3.5-turbo-16k is not possible without adding each file separately?
Just to test I generated ctags for my smallish Rust project and noticed it comes to around 10k tokens according to https://platform.openai.com/tokenizer.
I don't have GPT-4 API access yet but it appears it would get quite expensive with the 32k context.