[PartiallyTyped]

The problem with ChatGPT in a box and similar is that they are not made for live interactions. If you've tried chatGPT or claude on your phone with voice conversations you will see that it takes a while to think.

Humans on the other hand start processing the moment there's a response and will [usually] respond immediately without "thinking", or if they are thinking, they will say as much, but still respond quite quickly.

[throwaway314155]

Surely whatever solution they came up with amounts to "ChatGPT in a box" (using an llm with fewer parameters for speed).

[nsonha]

Not unlike voice mode on the ChatGPT mobile app, pretty responsive to me. Existing voice assistants do not set a high bar.