Incrementally learning model is pretty hard. That’s actually something I am working on right now and it’s completely different from developing/implementing LLMs.
I think that's what it's going to take. Eventually put the learning model in a robot body and send it out into the real world where there's no shortage of training data.