[maxnevermind]

> Given the enormous cost of training, would it be worth training new models then?

I'm not an expert, but is this even an option? I mean models must be refreshed with latest knowldge base periodically even without algo/design improvements, otherwise the lag become too noticeable and it will hurt users and their use-case.