[08d319d7]

Wholeheartedly agree. Latency is good, nice tech (Rust! Running at the edge on a consumer grade laptop!). I guess a natural question is: are there options to transplant a “better llm” into moshi without degrading the experience.

[aversis_]

But tbh "better" is subjective here. Does the new LLM improve user interactions significantly? Seems like people get obsessed with shiny new models without asking if it’s actually adding value.

[Kerbonut]

With flux, they have been able to separate out the unet. I wonder if something similar could be done here so parts of it can be swapped.

[dsmurrell]

Same question here.