|
|
|
|
|
by ta8645
478 days ago
|
|
> Would that make in-context learning a superset or a subset of pretraining? I guess a superset. But it doesn't really matter either way. Ultimately, there's no useful distinction between pretraining and in-context learning. They're just an artifact of the current technology. |
|