[coldtea]

>I’m using models to work on frameworks with nearly zero preexisting examples to train on

Zero preexisting examples of your particular frameworks.

Huge number of examples of similar existing frameworks and code patterns in their training set though.

Still not a novel thing in any meaningful way, not any more than someone who has coded in dozens of established web frameworks, can write against an unfamiliar to them framework homegrown at his new employer.

[thunky]

> Still not a novel thing in any meaningful way

Right. What you're saying is that barely anyone is doing truly novel work. 100% agree.

[coldtea]

Almost no e.g. web or app or enterprise or even game developer is doing any novel work, does that come as a surprise?

And is that fact supposed to be an argument in favor of how LLMs can do novel work and move the state of the art (which is what we're arguing about).

I mean, "LLMs can do novel work because: barely anyone is doing truly novel work" doesn't really compute as an argument.

[thunky]

What I'm saying is that LLMs don't have to do truly novel work in order to be useful. They are useful because the lion's share of all work is a variation on an existing theme (even if the creator may not realize it).

[kstrauser]

I'm not talking about web frameworks. I'm talking about other frontiers with darn near zero preexisting examples, and no code samples to borrow from in any language or in any similar framework (because there is no such thing).

"LLMs can only emit things they've been trained on" is wholly obsolete.

[coldtea]

>I'm not talking about web frameworks. I'm talking about other frontiers

Such as what?

>with darn near zero preexisting examples

Whatever it is, you'd be surprised.