|
|
|
|
|
|
by 0xblacklight
207 days ago
|
|
|
This is an excellent point - LLMs are autoregressive next-token predictors, and output token quality is a function of input token quality Consider that if the only code you get out of the autoregressive token prediction machine is slop, that this indicates more about the quality of your code than the quality of the autoregressive token prediction machine |
|
|
Considering that the "input" to these models is essentially all public code in existence, the direct context input is a drop in the bucket.