[dogcomplex]

Or as the model is able to be trained (integrated with new information) on the fly, making a somewhat limitless context window

[__loam]

I think there are actual technical problems in doing this.

[dogcomplex]

Well, cost prohibitive on big models obviously. But even just things like DreamBooth training extra associations to sets of new data images is tuning the model as you go