[jkbbwr]

Everyone keeps making the context windows bigger, which is nice.

But what about output? I want to generate a few thousand lines of code, anyone got any tips?

[bugglebeetle]

So context size actually helps with this, relative to how LLMs are actually deployed as applications. For example, if you look at how the “continue” option in the DeepSeek web app works for code gen, what they’re likely doing is reinserting the prior messages (in some form) to a new one to prompt further completion. The more context size a model has and can manage successfully, the better it will likely be able at generating longer code blocks.

[nejsjsjsbsb]

Isn't input/output lengths an arbitrary distinction. Under the hood, output becomes the input for the next token at each step. OpenAI may charge you more $$ by forcing you to add output to the input and call the API again. But running local you don't have that issue.

[mmaunder]

Repeatedly ask it for more providing the previous output as context. (Back to context length as a limitation)

[anotheryou]

Isn't that the same? limit-wise.

Now you just need to convince it to output that much :)

[AyyEye]

These things already produce embarrassing output. If you make it longer it's just going to get worse.