|
|
|
|
|
|
by williamtrask
272 days ago
|
|
|
I agree with you in a way - that it seems likely that new data will be incorproated in more inference-like ways. RAG is a little extreme... but i think there's going to be middle grounds betweeen full pre-training and RAG. Git-rebasin, MoE, etc. |
|
|