Hacker News new | ask | show | jobs
by rjb7731 1070 days ago
I've previously noticed when playing with GPT-4 it can sometimes 'autocomplete' on different sections of the text its feeding back, sometimes what looks like 4 or more different sections. Might be unrelated but is this MoE in action or them streaming the response in some way?
1 comments

This is just an issue with their frontend that seems to occur when it encounters \n\n. The actual data coming in only changes at the end of the message.